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the  general  state  of  training  in  the  army. 


G3  v  •  t.  a  v  v  '•  >  □  .-.s 


’  ARS'S/.r  -  S:  c  1-  '  '  (  .  • 

Unclassified 


DO  FORNHJ473.  wv/c 


*  a  f  ru*  '  '  •  <  ’  a  .  ,*♦ 


TRAINING  EFFECTIVENESS 
ANALYSIS  (TEA) 
SUMMARY 


I  U:-a:mcur.c?d 
j  Ja at  i t  cat  1  on. 


n 


Oict 


vi.Vuf  ion/ 

•i-  1  Uity  Cod» 3 
:/or 

I  wjeoial 


The  views,  opinions,  and/or  findings  contained  herein 
are  those  of  the  Army  Training  Study  Group  and  should 
not  be  construed  as  an  official  Department  of  the  Army 
or  US  Army  Training  and  Doctrine  Command  (TRADOC) 
position,  policy,  or  decision  unless  so  designated  by 
other  official  documentation. 


Protective  markings  may 
be  removed  upon  DA  ap¬ 
proval  of  the  Study. 


-FeR-OFf  - 


TRAINING  EFFECTIVENESS 


ANALYSIS  SUMMARY 


TABLE  OF  CONTENTS 


INTRODUCTION  TO  TRAINING  EFFECTIVENESS  ANALYSIS. 


ANNEXES 

ANNEX  A,  TRAINING  EFFECTIVENESS  ANALYSIS  1978 .  A-l 

APPENDIX  1  TRAINING  EFFECTIVENESS  ANALYSIS 

1978  MANAGEMENT  SYSTEM  PACKAGE .  A-l-1 

APPENDIX  2  TRAINING  EFFECTIVENESS  ANALYSIS 

1978  TEST  SYNOPSIS .  A-2-1 

ANNEX  B,  TRAINING  EFFECTIVENESS  ANALYSIS  1985 .  B-l 

APPENDIX  1  CORE  OBJECTIVES  AND  SITUATIONAL 

VARIABLES .  B-l-1 

ANNEX  C,  TRAINING  EFFECTIVENESS  ANALYSIS  1979 .  C-l 

APPENDIX  1  TRAINING  EFFECTIVENESS  ANALYSIS 

1979  CORE  OBJECTIVES  AND  SITUATIONAL  VARIABLES .  C-l-1 

ANNEX  D,  QUALITY  LEVEL  DEFINITIONS .  D-l 


PREPARED  BY: 

LTC  Gary  W.  Bloedorn 
LTC  William  Valen 
LTC  Thomas  R.  Stone 
LTC  Peter  T.  Zielenski 


■  ’  .■  *  *  '’  ■  ■  *  ■  ■  ■■  -  * 


v;.-'  .-  v'/’v 

iJULi/j.  V  .  .  .  <  .  .  LV.V. 


TRAINING  EFFECTIVENESS  ANALYSIS  SUMMARY  VOLUME 

(TEA) 


PURPOSE 

The  purpose  of  this  paper  is  to  describe  the  Training  Effectiveness 
Analysis  (TEA)  as  it  was  used  and  refined  by  members  of  the  Army  Training 
Study  (ARTS);  to  summarize  significant  findings  of  the  various  tests;  to 
outline  future  test  requirements ,  and  to  set  forth  ARTS  TEA  conclusions, 
recommendations,  and  observations. 

In  describing  the  TEA,  the  reader  will  be  introduced  to  the  concept  of 
the  present  TEA  and  the  relationship  of  TEA  to  the  Army  Training  System. 
Three  TEA  programs  will  be  discussed.  The  ARTS  developed  near  term  TEA 
programs  called  TEA  78,  was  designed  to  collect  data  on  fielded  pacing 
systems  and  Military  Occupational  Specialities  (MOSs).  A  second  TEA 
Program,  TEA  '85,  was  designed  to  collect  performance  data  on  develop¬ 
mental  systems.  A  third  TEA  program,  TEA  *79,  is  structured  to  complete 
TEA  '78  testing,  test  key  ARTS  concepts,  collect  confirming  data  for  the 
Battalion  Training  Model  (BTM) ,  and  allow  an  orderly  transition  to  TEA  85. 


CHALLENGES 
TO  ARMY  TRAINING 


Significant  trends  facing  today's  Army  pose  unique  training  chal¬ 
lenges.  The  increasing  capability  of  the  threat,  combined  with  present 
and  future  US  systems  complexity  and  density  and  with  attendant  cost 
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increases,  requires  soldiers  who  are  trained  to,  and  maintained  at,  a  high 
level  of  proficiency.  It  recent  trends  continue,  the  Army  cannot  rely  on 
increased  resources  alone  to  meet  these  challenges.  While  better  training 
appears  to  offer  the  most  promising  solution,  there  is  urgent  need  to 
provide  solid  reliable  data  to  assist  Army  commanders  in  making  the  best 
possible  training  and  resource  decisions.  In  today's  high  threat  environ¬ 
ment  the  margin  of  error  is  small.  » 


SYSTEMS  PERFORMANCE 
IS  SOLUTION  TO  CHALLENGES 


The  Training  Effectiveness  Analysis  (TEA)  is  an  appropriate  tool  to 
use  to  collect  the  needed  reliable  data.  The  TEA  has  been  designed  by 
TRADOC  to  provide  data  about  alternative  training  programs  in  terras  of 
costs  and  effectiveness,  and  to  aid  in  selection  of  the  most  efficient  ’ 

training  program.  TEA  results  provide  the  basis  for  identification  of 
precise  mission  performance  standards. 

The  TEA  is  also  conducted  to  provide  data  about  costs  (people,  dollars, 
and  time!  required  to  gain  proficiency  by  use  of  each  of  these  specific 
training  program  alternatives. 
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ROLE  OF  THE  TEA 
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The  evolving  Array  Training  System  must  be  readily  understood  and  use- 
able  by  all  levels  of  Che  defense  community.  As  an  emerging  technique, 
the  Training  Effectiveness  Analysis  (TEA1  has  been  used  by  the  Army 
Training  Study  (.ARTS!  to  determine  proficiency  development  profiles  across 
a  broad  spectrum  of  combat,  combat  support  and  combat  service  support  job 
requirements.  The  role  of  the  TEA  within  the  ARTS  study  is  to  provide 
data  necessary  to  exploit  known  and  potential  advances  in  instructional/ 
training  technology. 

As  the  initial  ARTS  effort  ends,  testing  has  been  completed  on  most 
pacing  systems,  yet  much  remains  to  be  done.  Development  of  prototype 
methodology  needed  for  TEA  B3  programs  is  just  beginning  with  XMI 
Operational  Test  (0T1  II;  testing  of  forward  observer  training  continues; 
and  tol low-on  testing  of  command  group  training  techniques  is  needed. 
Success  of  the  prototype  BTM  highlights  the  need  to  test  BTM  derived 
training  concepts  and  programs.  Lastly,  use  of  the  TEA  has  already  pro¬ 
duced  useful  data  and  insights  concerning  refinement  of  the  test  process 
to  meet  future  developmental  training  challenges. 
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The  TEA  was  also  chosen  as  a  device  to  analyze  both  institutional  and 
unit  training.  This  approach  was  considered  to  be  particularly  appropriate 
as  TEA  had  been  designed  by  TRADOC  prior  to  the  initiation  of  the  ARTS 
effort  to  facilitate  the  analysis  of  training  alternatives  through 
testing.  The  innovative  concepts  behind  the  TEA  had  been  formulated  by 
TRADOC  and,  thus,  useful  data  concerning  training  requirements  and  what 
had  to  be  done  to  enhance  the  TEA  process  was  already  available  when  the 
study  began.  Results  of  TRADOC  initiated  TEA  were  provided  throughout  the 
period  of  study.  TEA  concepts  and  procedures  presented  in  this  paper  have 
drawn  heavily  on  previous  TRADOC  products.  ARTS  findings  are  that  an 
effective  TEA  is  a  vital  part  of  the  training  system. 

REASONS  FOR  CONDUCTING  TEA 

TEA  have  different  purposes  depending  on  when  they  are  conducted. 

a.  During  concept  and  validation  phases  of  hardware  and  support  sub¬ 
system  design,  a  TEA  is  conducted  to  provide  data  concerning  human  consid¬ 
erations  that  will  allow  trade-offs  in  design  to  facilitate  training. 

b.  During  full  scale  development  of  equipment,  a  TEA  provides  data  to 
bo  used  in  the  selection  of  the  most  efficient  training  subsystem  within 
constraints  of  hardware  design,  personnel,  and  logistics  subsystems. 

c.  A  TEA  is  conducted  whenever  changes  in  the  environment,  over  time, 
degrade  the  compatibility  of  subsystems  to  the  point  where  performance 
proficiency  falls  significantly  short  of  system  capability. 

d.  Finally,  a  TEA  should  be  conducted  to  match  requirements  in 
support  of  design  of  training  packages  to  meet  operational  problems. 
Examples  of  these  problems  can  be  found  in  the  unique  training  challenges 
facing  Reserve  Component  units,  the  problems  of  training  with  reduced 
resources  (people,  dollars,  and  time),  and  training  to  maintain 
proficiency  under  the  severe  conditions  of  turnover  and  turbulence. 

Whenever  a  TEA  is  conducted,  however,  the  TEA  must  inform  decision-makers 
about  the  effectiveness  and  cost  implications  of  alternative  training 
programs,  techniques,  and  concepts  as  related  to  specific  weapon  systems, 
equipment,  and  job  performance.  It  is  clear  that  required  proficiency 
cannot  be  reliably  attained  and  maintained  unless  equipment,  training 
programs,  and  documentation  are  appropriate  for  use  by  field  units.  TEA 
are  conducted  to  ensure  that  training,  equipment,  personnel  and  logistical 
subsystems  are  molded  into  a  more  effective  total  system. 

WHO  PERFORMS  TEA? 

TEA  are  normally  performed  by  a  study  team  led  by  the  training  devel¬ 
oper  from  the  appropriate  TRADOC  school  or  center.  Because  the  TEA 
process  collects  and  analyzes  data  across  the  spectrum  of  human 
performance  and  equipment  development  disciplines,  study  groups  are 


required  with  representation  from  such  organizations  as  the  Army  Research 
Institute  (ARI)  for  human  performance  factors;  TRADOC  Systems  Analysis 
Agency  (TRASANA)  to  analyze  and  integrate  data,  and  the  DARCOM  Human 
Engineering  Laboratory  (HEL)  to  ensure  equipment  compatibility  with  the 
training  and  learning  processes. 

TEA  RELATIONSHIP  TO  TRAINING  SYSTEM 


MODEL... 

ARMY  TRAINING  SYSTEM 


The  ARTS  Model  provides  rationale  to  justify  resources  required  to 
train  to  threat  defeating  standards.  The  ARTS  TEA  is  designed  to  provide 
data  in  support  of  this  rationale  through  rigorous  tests  by  relating 
resources  (people,  dollars,  and  time)  used  in  the  training  base  and  unit 
to  attain  and  maintain  a  specified  level  of  individual  and  collective 
training  proficiency.  Further,  the  TEA  provides  data  necessary  to  develop 
standards  of  proficiency  and  methods  to  verify  attainment  of  these  stan- 
ards.  Because  TEA  procedures  provide  for  controlled  data  collection,  the 
TEA  product  can  be  used  for  input  to  verification  techniques.  In  this 
manner,  it  is  possible  to  more  precisely  estimate  the  effects  of  indivi¬ 
dual  and  collective  performance  on  combat  effectiveness. 
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TEA  WITHIN  THE  ARTS  STUDY  FRAMEWORK 


COMBAT 


COMBAT 

SUPPORT 

COMBAT  SERVICE 
SUPPORT 


The  TEA  forms  an  integral  part  of  the  ARTS  analysis  and  is  a 
continuing  process  vital  for  use  of  the  ARTS  Model  of  an  Army  training 
system.  Three  TEA  progams — TEA  78,  TEA  85,  and  TEA  79 — have  been  designed 
by  members  of  the  ARTS  group  and  will  be  discussed  in  turn. 


The  TEA  78 
selected  comba 
and  MOSs.  The 
elements  of  in 
essential,  for 
information  is 
to  verify  rela 
vey  data  used 
and  time,  data 
to  previously 
personnel,  and 


program  was  originally  designed  to  collect  limited  data  on 
t,  combat  support,  and  combat  service  support  pacing  systems 
primary  purpose  was  to  provide  initial  data  as  to  essential 
formation  in  the  study  directive.  Data  provided  by  TEA  is 
while  the  ARTS  model  provides  a  conceptual  framework, 
needed  to  provide  answers  to  questions  posed  by  the  model, 
tionships  established  in  the  model,  and  to  confirm  the  sur- 
in  the  BTM.  Due  to  resource  constraints  of  people,  dollars, 
collection  was  limited  to  three  major  sources:  TEA  add-ons 
scheduled  tests,  quick-response  tests  designed  by  ARTS 
reliance  on  other  recently  completed  tests  and  studies. 


TEA  RELATION 
TO  TRAINING  READINESS 


As  shown  above,  the  TEA  process  provides  a  methodology  to  relate 
training  resource  input  to  readiness  output  to  provide  a  body  of  data  to 
be  used  to  formulate  the  best  possible  training  recommendations  to  be 
proposed  to  decision  makers.  The  TEA  78  program  served  as  a  prototype  to 
develop  this  methodology. 

The  TEA  78  program  consisted  of  a  series  of  tests  on  the  M60A1  tank 
( 1 1 E ) ,  the  Redeye  Air  Defense  System  (16P),  the  TOW  (11H),  forward 
observer  (13F),  63C/H  mechanic  and  05C  radio  operator.  TEA  78  results 
have  provided  valuable  insights  and  data  concerning  present  day  Active 
Army  training  and  proficiency  in  both  the  institution  and  in  the  field. 
Through  the  medium  of  planning,  coordinating  testing  and  visits  to  test 
activities  and  units,  members  of  the  ARTS  study  group  have  also  gained 
valuable  insights  and  experience  concerning  the  problems  of  conducting  TEA 
and  making  refinements  that  are  necessary  to  ensure  the  process  is  equal 
to  the  challenges  posed  by  planned  modernization  and  personnel  programs. 

A  summary  of  TEA  78  test  results  is  presented  in  this  paper.  A  synopsis 
of  all  tests  and  test  results  is  contained  in  Annex  A. 


ARTS  ORGANIZATION  FOR  TESTING 
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Subsequent  to  completion  of  TEA  78  test  design  and  coordination,  re¬ 
sponsibility  for  execution  of  the  TEA  78  program  was  given  to  the  Command¬ 
ants  of  the  opponent  TRADOC  schools.  These  Commandants  were  to  be  sup¬ 
ported  by  A-~.y  ‘'cientific  agencies  ‘•uch  as  ARI,  TRASANA,  and  the  Combat 
Development  E<pi*i  imentation  Command  vCDEC).  Most  TEA  78  test  reports  were 
scheduled  to  be  provided  to  ARTS  by  1  July  1978. 


1DWT  =  Division  ”ork  Team.  -Formed  with  each  participating  division. 
Normally  ov.  ,  .ulihed  by  the  Division  Chief  of  Staff. 


SWT  =  System  Work  Team.  .Formed  with  each  TRADOC  school. 
Chaired  by  ..hod  Ooimandant  or  his  representative. 
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When  TEA  '78  v.ns  passed  from  ARTS  to  the  TRADOC  schools  for  execution, 
members  of  491S  group  started  planning  for  TEA  '85.  The  purpose  of 

the  TEA  '85  program  is  the  collection  of  data  to  ensure  through  the 
development  of  an  effective,  efficient,  and  justifiable  training  system, 
the  timely  and  effective  assimilation  of  new,  complex,  weapons  systems 
scheduled  to  enter  the  Array  between  1978  and  1985. 

Types  of  approaches  introduced  in  the  program  include  the  performance 
decay  analysis  and  survey  techniques  being  piloted  by  TEA  '78.  The  TEA 
'85  program  dso  introduced  two  additional  concepts:  core  objectives  and 
situational  tuiables.  These  concepts  arose  from  interim  ARTS  observa- 
t ions . 
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CORE  OBJECTIVES  AND  SITUATIONAL  VARIABLES 


Vivl-Tl  INSIGHTS  INTO  TRAEKAFJLITY 

i  JXJ  FOR  DEVELOPING  SYSTEMS 


Core  objectives,  connon  to  all  tests,  were  specifically  designed  to 
test  for  key  issues  in  order  to  guide  the  subsequent  development  of 
suitable  training  packages  for  '85  systems  and  to  feed  the  ARTS  model  and 
STM.  These  core  objectives  must  be  satisfied  to  ensure  valid  training 
testing.  Collection  of  data  on  threat-oriented  critical  tasks,  training 
costs  (people,  dollars,  and  time),  performance  decay  for  individual  and 
collective  critical  tasks,  and  the  frequency  of  retraining  required  to 
regain  proficiency  is  needed  to  enable  commanders  to  make  early  trade-off 
decisions  between  hardware  design  and  alternative  training  programs. 

These  trade-offs  can  best  be  made  early  in  the  development  cycle  before 
hardware  design  is  frozen.  Therefore,  the  investigation  should  be  made 
while  weapon  systems  and  equipment  are  still  in  the  development  stage. 

Early  collection  of  data  is  essential  to  the  formulation  of  proper  solu-  • 

tions  to  these  problems.  Such  solutions  might  include  well  thought  out 
changes  to  the  personnel,  logistics,  and  training  subsystems  so  that  the 
weapon  or  equipment  under  development  can  be  expected  to  perform  at,  or 
above,  design  capability.  The  TEA  ‘85  program  provides  a  framework  for 
investigation  of  these  operational  problems  during  testing.  While  opera¬ 
tional  problems  vary  in  intensity  from  unit  to  unit,  most  of  them  are 
faced  to  some  degree  by  today's  trainers.  These  operational  problems  have 
been  termed  situational  variables.  They  range  from  personnel  manning 
conditions,  reduced  time  to  train,  and  training  with  reduced  resources,  to 
training  for  special  operations  and  conditions.  A  discussion  of  these 
situational  variables  and  core  objectives  is  at  Annex  B,  TEA  '85. 
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CONCEPT  OF  TEA  '85 


Due  to  the  limited  time  and  money  available,  the  proposed  TEA  '85  test 
plan  recommended  gradual  test  development.  Initial  testing  was  focused  on 
"piggybacking"  or  "adding  on"  to  already  scheduled  OT's  and  Weapons 
Systems  Training  Analyses  (WSTEA),  proceeding  from  tests  of  minimum 
resource  requirements  in  the  short  term  (individual,  section,  platoon 
requirements,  etc.)  to  greater  resource  requirements  in  the  long  term,  and 
proceeding  from  simple  test  to  complex  tests  (complexity  of  equipment, 
level  of  skill,  etc.).  For  instance,  for  the  near  term  effort,  the  XMI 
OTII  test  (May-Dec  1978),  in  which  only  a  tank  platoon  is  involved,  was 
selected  to  address  the  relatively  simple  but  most  important  core  objec¬ 
tives,  as  well  as  situational  variables  relating  to  MOS  transition 
training  and  new  equipment  assimilation.  The  long  term,  the  XMI  OTIII 
(Jun-Dec  1980),  in  which  an  entire  Armor  battalion  is  involved,  was 
selected  to  address  the  more  complex  variables  of  resources  required  to 
attain  unit  proficiency,  equipment  pools,  and  equipment  surv ivab i 1 i ty 
training  as  well  as  the  effect  of  less  capable  trainees,  increased 
turbulence,  and  trainer  grade  substitution.  The  test  program  provided  for 
testing  within  the  framework  of  the  ARTS  Model,  and  included  tests  of 
weapons,  equipment,  individual  MOS,  unit  training  tests,  testing  of 
command  groups,  and  of  Reserve  Components.  Planning  provided  for  full 
implementation  of  the  concepts  to  all  operational  testing  beginning  in  FY 
1  982. 
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TEA  '78  MANAGEMENT  SYSTEM 


Actions  taken  to  upgrade  the  quality  of  the  ARTS  TEA  tests  are  aggre¬ 
gated  under  one  cover  in  the  TEA  '78  Management  System  package  at  Annex  A. 

The  TEA  '78  Management  System  package  provides: 

a.  A  summary  listing  of  tests  included  in  TEA  '78  as  well  as  a 
listing  of  additional  tests  which  were  selected  for  inclusion  in  the  TEA 
because  of  their  potential  to  provide  information  which  would  upgrade, 
expand,  and/or  validate  needed  data. 

b.  Work  sheets  for  each  test  which  served  to  coordinate  major  test 
milestones  and  activities  by  outlining  test  objectives,  sample  sizes, 
links  to  the  ARTS  model,  major  test  activities,  and  scheduled  dates  at 
which  SWT  or  test  agency  reports  were  due.  These  worksheets  served  to 
coordinate  major  test  milestones  and  activities. 

c.  A  summary  of  TEA  '78  deliverable  products  which  portrayed  test 
activities  in  terms  of  the  various  areas  of  training  interest,  and  linked 
each  TEA  '78  test  with  different  aspects  of  ARTS  to  include  the  BTM  and 
TEA  '85  core  objectives  and  situational  variables.  This  linkage  served  as 
a  planning- guide  for  test  agencies  to  extract  additional  data  from 
on-going  tests. 

d.  An  ARTS  designed  reporting  handbook  which  provided  a  common  format 
for  the  study  of  test  results  and  conclusions.  The  utility  of  this  hand¬ 
book  was  that  it  enabled  ARTS  action  officers  to  synthesize  numerous  re¬ 
ports.  Use  of  this  technique  facilitated  cross-referencing  of  data, 


established  consistency,  and  provided  continuity  of  effort  within  test 
agencies  supporting  ARTS.  The  handbook  also  used  an  alphanumeric  .code  to 
identify  elements  of  information  in  relation  to  the  ARTS  Model.  Using 
this  system,  ARTS  analysts  can  synthesize  data  relating  to  any  segment  of 
the  ARTS  model  across  the  full  range  of  TEA  '78  data.  Elements  of  informa¬ 
tion  can  be  assembled  into  new  combinations  or  contrasted  as  appropriate. 

As  an  example,  costs  of  individual  training  in  the  institution  for  MOS 
11E,  16P,  and  63  C/H  can  be  arranged  quickly  into  one  module  for  compari¬ 
son/contrast  as  desired.  The  system  used  to  code  elements  of  data  also 
forms  the  foundation  for  the  ARTS  data  base.  This  data  base  is  a 
computerized  data  retrieval  system  which  should  be  developed  apace  with 
TEA  79  to  serve  as  a  common  repository  for  TEA/survey  data.  Designed  to 
be  compatible  with  the  BTM,  the  data  base  is  an  essential  element  in  the 
linking  of  TEA  with  the  BTM. 

e.  An  ARTS  training  resources  methodology  which  was  formulated  early 
in  the  study,  was  designed  to  provide  guidance  for  collecting  data  for  the 
development  of  relationship  between  resources  and  training  conducted  in 
the  training  base  and  in  the  unit.  It  contains  cost  factors,  costing 
ground  rules,  input  requirements,  and  common  reporting  formats. 

The  ARTS  Staff  coordinated  all  elements  of  the  updated  TEA  '78  program 
with  proponent  TRADOC  school  SWTs  and  supporting  analytical  agencies  and 
MACOM  liaison  officers.  This  coordination  is  discussed  in  the  memorandum 
at  Incl  5  of  Appendix  I,  Annex  A.  The  experiences  gained  in  planning  for 
and  conducting  TEA  '78  have  also  served  to  generate  a  broad  body  of  know¬ 
ledge  necessary  for  the  conduct  of  TEA  '79. 

TEA  '78  SUMMARY  OF  FINDINGS 
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Although  TEA  '78  tests  were  limited  to  several  key  systems  and  MOS , 
some  general  indicators  of  the  overall  status  of  training  in  the  Army  were 
developed.  These  indicators  seem  to  apply  across  the  total  force. 

Test  results  suggest  that  the  overall  level  of  Army  training  and 
proficiency  may  be  low.  Trends  that  emerge  as  general  across  the  ARTS 
sample  include  shortfalls  between  actual  system  performance  and  design 
capability  (this  is  particularly  true  of  tank  crews  and  mechanics);  low 
levels  of  successful  soldier's  manual  task  completion  in  units,  partic¬ 
ularly  in  operator  maintenance  skills;  significant  numbers  of  lower  mental 
group  personnel  entering  the  force  with  some  attendant  increased  training 
requirements;  low  levels  of  training  management  competence  and  leader 
skills  on  those  individual  SM  tasks  they  are  expected  to  supervise;  and 
expressed  dissatisfaction  with  training  and  maintenance  conditions  and 
procedures  (68?  of  1288  tank  crewmen  surveyed  in  the  M60A1  Modified  WSTEA 
Study  chose  to  comment  on  the  survey  as  to  unit  training  improvements 
needed).  Most  of  the  comments  were  negative  and  stressed  a  recurrent 
theme  that  training,  proficiency,  and  equipment  maintenance  were  poor. 

In  contrast,  although  limited  in  scope,  the  REALTRAIN  tests  and  the 
rapid  train-up  of  tank  crewmen  tests  (27  tank  crews  total)  demonstrated 
the  performance  potential  characteristic  of  good  training.  Demonstrated 
performance  of  SL  1  soldiers  in  institutional  training  was  high  and  skill 
retention  was  not  discouragingly  low.  Today's  soldier  appears  to  be 
trainable  and  eager  to  train.  It  would  appear  that  the  absence  of  solid, 
planned  training  is  the  cause  of  much  of  the  poor  performance  noted. 

A  summary  of  test  results  follows.  The  ARTS  assessment  of  the  quality 
level  of  the  data  (explained  in  Annex  D  and  available  as  a  fold  out  on  the 
last  page  of  this  volume)  is  portrayed  with  each  finding: 

TANK  QUALITY  LEVEL 

.  A  large  percentage  (50  percent  of  armor  crewmen  (QL  2) 

tested  in  the  proficiency  and  retention  study)  had 
not,  within  2-25  weeks  of  joining  units,  been 
assigned  to  a  tank  or  if  assigned  had  not  been 
given  a  specific  crew  position,  (n  =  270) 

.  Approximately  50  percent  of  armor  crewmen  partici-  (QL  1) 

pating  in  the  M60A1  WSTEA  claimed  to  have  fired  table 
VIII  in  a  tank  other  than  their  own.  (n  ■  356  tank  crews) 

.  No  significant  difference  has  been  found  between  (QL  4) 

levels  of  turbulence  in  CONUS  and  USAREUR  tank  battal¬ 
ions.  (-Care  must  be  exercised  in  extrapolating  this 
data  to  all  CONUS  units.  Battalions  surveyed  had  been 
stabilized  to  support  forward  deployment  commitments, 
i.e.,  Bde  78  type  rotation). 
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TANK 


QUALITY  LEVEL 

Survey  data  indicates  that  average  daily  present  for  (QL  3) 

training  percentages  across  30  tank  companies  in  CONUS 
and  USAREUR  are  below  70  percent  of  authorized  strength. 

During  the  test  program,  personnel  in  mental  category  (QL  1) 

III  constituted  the  majority  of  entry  level  soldiers  in 
MOS  19E/F.  (Unable  to  distinguish  IIIA  from  IIIB) 

Instability  is  endemic  in  tank  units  tested.  Data  col-  (QL  2) 

lected  indicates  that  most  turbulence  of  crew  members  occurs 
within  tank  units  at  company  level  and  below.  This  finding 
is  consistent  with  tank  force  management  group  conclusions 
that  more  than  "55  percent  of  all  turbulence  was  generated 
within  the  battalion."  Stability  profiles  of  ten  M60A1 
battalions  in  USAREUR  and  CONUS  showed  mean  time  in  units 
to  be : 

USAREUR  CONUS 

Company  -  16  mo.  15.3  mo. 

Platoon  -  12  mo.  12.6  mo. 

Tank  -  3.3  mo.  3.0  mo.  (Months  since  change 

in  tank  crew) 

The  majority  of  tank  crewmen  indicated  the  need  (QL  2) 

for  more  and  better  training  in  their  units.  (n  = 

1288) 

Tank  unit  training  programs  require  improvement.  (QL  3) 

Units  demonstrated  a  lack  of  ability  to  plan  and 
conduct  training  leading  to  performance  improve¬ 
ments.  Proficiency  and  retention  testing  estab¬ 
lished  that  Basic  Armor  Training  (BAT)  graduates 
received  little  or  no  training  on  basic  armor 
crewmen  skills  since  joining  the  unit.  Training 
that  had  been  conducted  did  not  result  in  pro¬ 
ficiency  (n  =  270).  These  findings  were  rein¬ 
forced  by  the  low  performance  levels  of  63C/H,  05C, 
and  19E  tank  commanders  and  gunners  in  all-related 
testing. 


QUALITY  LEVEL 


TANK 

.  A  higher  degree  of  leaining  occurs  within  the  insti-  (QL  3) 

tution  than  in  the  units  for  Armor  crewmen.  Retention 

testing  by  the  US  Army  Armor  School  established  a  96  per¬ 
cent  "Go"  rate  on  rink  crewmen  skill  tests  regardless 
of  mental  gro"p.  Follow-on  testing  established  a  20Z 
performance  .'ecay  in  SM  tasks  occurring  2  weeks  after 
unit  ass  ig'irr.ont  >.nd  leveling  off  without  further  decay 
through  25  u^eks  after  unit  assignment.  Performance 
decay  was  s igni f  icant ly  greater  among  lower  mental  groups 
(n  =  220). 

.  Training  programs  for  Armor  crewmen  should  emphasize  (QL  1) 

training  tine  of  tank  commander  and  gunner  together. 

.  The  more  training  a  tank  commander  receives,  the  short-  (QL  1) 
er  the  opening  times.  The  pronounced  effect  of  leader 
dominance  leads  to  a  conclusion  that  crewmen  should  be 
trained  up  to  tank  cormander  skills  as  well  as  cross- 
trained  . 

.  The  more  training  a  gunner  receives,  the  more  main  gun  (QL  l) 

hits  the  cr<.v  achivos. 

.  Tank  crew  gunnery  knowledge  dewonst rated  (QL  2) 

by  key  persounel  was  often  low.  Seventeen 
and  21  percent  of  the  tank  commanders  in 
USAREUR  and  CONUS  respectively  did  not  know 
where  to  aim  when  employing  battlefield  gunnery 
techniques  ( bat t les ight s ) .  Further,  twenty-one 
and  28  percent  of  the  gunners  in  USAREUR  and 
CONUS  respectively  did  not  know  where  to  aim 
when  using  Latt  les  igl.ts  (n  3  356). 

.  Tank  crew  probability  of  main  gun  hits  at  range  (Ph)  (QL  2) 

was  input  to  the  tank  exchange  model  (TXM)  resulting 
in  blue/red  exchange  ratios.  Exchange  ratios  indicated 
that  tank  crew  piuficieucy  is  40  to  50  percent  below 
what  it  would  be  if  the  crews  fired  the  quasi-combat 
Ph  in  USAREUR  and  CONUS  respectively  (n  3  356). 

.  Changing  Armor  crewmen  positions  without  training  (QL  3) 

the  crewmen  specifically  for  the  new  position  leads 
to  reduced  crew  performance. 
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TANK 


QUALITY  LEVEL 


Indications  were  found  that  intensive,  narrowly  focus¬ 
ed  training  to  criteria  on  critical  tasks  (modular 
training)  can  result  in  rapid  acquisition  of  tank 
crew  proficiency  if  an  experienced,  proficient  leader 
is  present.  Additional  testing  is  required  both  to 
validate  the  concept  of  modular  training  for  Reserve 
Components  (RC)  and  wartime  replacements  and  to  con¬ 
firm  the  extent  of  leader  dominance  on  tank  crew  per¬ 
formance  . 

As  presently  employed,  table  VIII  is  a 
poor  measure  of  performance.  Criteria  for 
scoring  varied  significantly  between  batta¬ 
lions  in  USAREUR,  and  between  USAREUR  and 
CONUS  while  range  limitations  of  table  VIII  in 
USAREUR  precluded  realistic  use  of  precision 
gunnery  techniques.  Tanks  in  USAREUR  and 
CONUS  are  restricted  to  movement  on  the  road 
and  do  not  employ  fire  on  the  move  (AOS) 
techniques.  Consequently,  use  of  table  VIII 
scores  as  a  measure  of  proficiency  is  of  doubt¬ 
ful  utility. 

Lower  mental  category  personnel  can  be  trained 
to  proficiency.  (96  percent  +  of  CAT  III  and  IV 
performed  satisfactorily  on  the  mid-cycle  and  end- 
of-cycle  tank  crewman  qua  1  i  f icat  ion  tests  admini¬ 
stered  at  the  Armor  Center).  (n  =  286  &  150  repec- 
t ive  ly  )  . 


REDEYE 


Current  levels  of  training  resources  are  required 
if  Redeye  gunner  proficiency  is  to  be  maintained. 

Additional  Moving  Target  Simulators  (MTS)  are 
required  to  support  units  in  close  proximity  to 
existing  MTS  and  to  provide  for  more  retraining 
for  lower  mental  category  personnel  entering  the 
MOS. 

Redeye  Launch  Simulator  (RELS)  should  be  procured 
as  a  training  aid. 


1  7 


(QL  3) 

(QL  4) 


(QL  3) 

(QL  3) 
(QL  3) 


(QL  3) 
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REDEYE 


QUALITY  LEVEL 


-  ■ 


Allocation  of  live  Redeye  rounds  for  Annual  Service  (QL  4) 
Practice  (ASP)  should  remain  the  same. 

Significant  correlations  between  training  frequency  (QL  1) 
and  length  of  time  spent  on  Moving  Target  Simulator, 

(MTS)  and  Range  Ring  Profile  (RRP),  and  proficiency 
were  found  in  Redeye  testing. 

CAT  IV'  Redeye  gunners  are  able  to  achieve  (QL  1) 

an  acceptable  level  of  proficiency  in  MTS 
training,  but  demonstrated  unacceptable 
performance  levels  in  use  of  the  RRP. 

Determination  of  range  ring  coverage  is  the  (QL  1) 

most  difficult  task  for  all  gunners  of  all 
categories  with  respect  to  the  RRP. 

Lower  mental  category  personnel  can  be  trained  (QL  3) 

to  proficiency.  Indications,  however,  are  present 
that  it  takes  longer  and  that  more  frequent  re¬ 
fresher  training  is  required.  This  is  consistent 
with  literature  research.  (An  exception  appears 
with.  CAT  IV  Redeye  gunners  and  the  RRP.  CAT  IV 
personnel  were  unable  to  learn  the  RRP  (n  =  91.) 

63  C/H  Mechanic 

Experienced  maintenance  personnel  in  the  unit  (QL  2) 

(grades  E-4  —  E  —  7 )  performed  at  a  low  level.  This 
level  was  equivalent  to  the  SL  1  AIT  graduate. 

Essentially  performance  remained  the  same,  over 
time. 

demonstrated  job  performance  levels  of  63C/H  (QL  4) 

personnel  are  such  that  equipment  operational 
rates  could  be  reduced  severely  if: 

-  mechanics  were  required  to  work  across  the  broad 
spectrum  of  their  MOS  as  they  would  have  to  do 

in  wartime  rather  than  operate  in  narrowly 
focused  areas  as  they  often  do  today. 

-  r.'plsiciaent  parts  availability  were  restricted 
it  v'uld  be  m  wartime  and  maintenance  depended  on 
iiivn  'itlcs  and  repair. 
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The  organization  best  suited  for  conduct  of  the  TEA  builds  on  the 
experience  of  personnel  now  serving  in  the  SWT  and  analytical  agencies. 
Many  of  these  personnel  are  continuing  to  conduct  holdover  TEA  '78  tests. 
Participation  in  TEA  suggests  that  each  service  school  commandant  estab¬ 
lish  a  nucleus  of  field  grade  officers  (one  of  whom  is  ORSA-qua 1 i f ied ) 
augmented  by  a  small  administrative  staff.  The  SWT  should  report  to  the 
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Eleven  ongoing  tests  and  studies  from  TEA  '78  have  been  incorporated 
in  the  TEA  '79  program.  They  include  armor  reserve  component  testing, 
forward  observer  testing,  the  TOW  TEA  test,  training  instrumentation 
testing  (TIE  Test)  and  research  into  artillery  cannon  crew  turnover  and 
retention  of  common  skills. 

Test  initiatives  include  research  into  tank  crew  performance  potential 
through  stabilization;  follow-on  command  group  training  through  use  of 
CAMMS  and  CATTS  with  eventual  verification  of  proficiency  gain  on  an  in¬ 
strumented  battlefield,  XM1  OTII,  follow-on  testing  of  63C/H  mechanics  to 
determine  the  best  way  to  use  the  proficiency  of  the  training  base  to 
raise  proficiency  in  the  field,  and  additional  testing  of  armor  skill 
performance  decay  under  more  controlled  conditions.  The  program  also 
includes  plans  to  test,  with  the  aid  of  the  BTM,  units  trained  by  the 
multiechelon,  integrated  training  and  the  battle  drill  battalion  training 
program  developed  by  members  of  the  ARTS  study  group. 

CONCLUSIONS  AND  RECOMMENDATIONS 


Conclusions  and  recommendations  are  based  upon  TEA  '78  findings, 
professional  military  judgements  and  lessons  learned  while  developing  the 
three  ARTS  TEA  programs.  Two  areas  of  concern  are: 

-  Training  Effectiveness  Analysis  (TEA):  The  dominant  finding  across 
the  spectrum  of  TEA-related  activities  is  that  the  Army  has  only  partially 
implemented  the  Instructional  Systems  Development  (ISD)  model.  The  ISD 
process  is  vital  to  an  efficient  and  effective  Army  Training  System,  and 
to  developmental  testing  of  new  equipment.  Implementation  of  TEA  process 
is  essential  to  improved  training. 

-  Training:  Most  of  the  performance  tested  during  conduct  of  TEA  '78 
research  fell  short  of  existing  standards.  While  the  TEA  program  was  not 
comprehensive,  it  did  sample  pacing  systems  and  MOS  across  a  wide  spectrum 
of  Active  Component,  and  to  a  much  lesser  extent,  Reserve  Component  units. 
Conclusions  and  recommendations  regarding  training  are  oriented  toward 
improving  terminal  performance.  Conclusions  are  formulated  from  test 
data,  by  synthesis  of  consistent  trends  and  high  resolution  findings. 
Conditions  which  cannot  be  directly  supported  by  specific  data  are 
presented  as  observations.  These  observations  are  the  considered  profes¬ 
sional  judgement  of  members  of  the  ARTS  group  based  upon  on-site  test 
evaluations,  conferences,  research,  and  intensive  study  of  test  results. 


TEA  Conclusions  and  Recommendat ions 


CONCLUSION: 


Efficient,  timely  conduct  of  TEA  by  use  of  the  ARTS  TEA  model  is 
essential  to  continued  development  of  training  data  needed  by  the  BTM. 

RECOMMENDATION:  PRIORITY  1 

TRADOC  (ARTS) — Continue  development  of  ARTS  designed  training  data 
base . 


TRADOC — Institutionalize  flow  of  data  from  TEA  to  data  base,  by 
continued  development  of  data  base  system  designed  by  ARTS  Phase  II. 

Present  TEA  methodology  and  test  proponent/ agency  capabilities  are  not 
sufficient  for  the  tasks  inherent  in  TEA  '85.  Problems  identified  by  the 
TRADOC  Staff  include: 

1.  Inadequate  performance  criteria  is  available  to  testers. 

2.  Tests  often  poorly  represent  user  operational  problems. 

3.  Too  little  use  is  made  of  performance  analysis  techniques  and 
available  tehnology. 

4.  There  are  too  few  trained  test  planners. 

RECOMMENDATION :  PRIORITY  2 

TRADOC: 

a.  Conduct  TEA  '79  as  designed  by  the  ARTS  Study  Croup. 

b.  Develop  methodology  and  fully  procedura 1 ized  test  model  (as 
outlined  by  the  TEA  '83  program)  supported  by  adequate  job  aids  for 
developmental  testing  during  conduct  of  TEA  '79  in  order  to: 

(1)  Refine  survey  derive  people,  time  and  dollar  costing  data 
currently  factored  into  the  BTM. 

(2)  Determine  training  proficiency  as  a  function  of  frequency  of 
repet  it  ion. 

(3)  Provide  data  on  training  proficiency  and  relative  costs  as  a 
function  of  sub-caliber  substitution  and  employment  of  resource  conserv¬ 
ing  gunnery  training  devices. 


c.  Transfer  TEA  '79  from  ARTS  Phase  II  to  HQ  TRADOC  NLT  1  Oct  78. 


d.  Implement  concepts  outlined  in  TRADOC  designed  draft  "TRADOC 
Systems  Manager's  (TSM)  Guide  to  Training  Development  and  Acquisition  for 
Major  Systems,"  dated  13  Dec  77,  throughout  the  TSM  and  school  .  tr a  in i ng 
developments  community  in  conjunction  with  TEA  '79. 

CONCLUSION: 

1.  Increasing  threat  capability,  present  and  future  systems 
complexity  and  density,  with  attendant  cost  increases,  require  soldiers 
and  leaders  who  are  sustained  at  a  high  level  of  training  readiness. 

2.  The  majority  of  enlisted  accessions  in  test  samples  are  mental 
category  III  and  IV  personnel  who  require  enhanced  initial  training  and 
more  frequent  refresher  training  to  maintain  proficiency. 

3.  Complex  skills  often  require  more  frequent  refresher  training. 

RECOMMENDATION:  PRIORITY  3 

TRADOC:  Implement  an  expanded  TEA  '83  program  to  develop  training 

sub-systems  based  on  core  objectives  and  situational  variables  phased  as 
o u  1 1  ined  be  low : 

a.  Implement  TRADOC  DCST  TEA  program  for  FY  79-80  as  planned. 

b.  Implement  ARTS  TEA  '85  program  for  FY  81-82  with  testing  of  core 
objectives  and  situational  variables.  Planning  complete  for  PARR  submis¬ 
sion  NLT  1  Feb  79. 

c.  Apply  TEA  '85  methodology  to  all  operational  testing  in  FY  83. 

CONCLUSION: 


Due  to  a  general  absence  of  effective  training  in  many  units,  unit 
training  readiness  is  heavily  dependent  on  institutional  excellence. 
Efforts  to  upgrade  training  base  capability  are  usually  cost  effective  and 
are  beneficial  to  unit  collective  training  capabilities. 

RECOMMENDATIONS:  PRIORITY  1 

TRADOC:  -  Develop  a  program  coordinated  with  MACOMs  to: 

1.  Capitalize  on  training  advantages  unique  to  the  institution  by: 

a.  Exporting  institutional  proficiency  tests  to  the  field. 

b.  Establishing  a  program  of  spot  checking  proficiency  of  replace¬ 
ments  upon  arrival  in  unit  by  these  tests. 
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c.  Exporting  inst itut  ional  training  materials  to  support  remedial 
training  in  the  units  of  individuals  found  to  be  deficient. 

2.  Develop  a  full  range  of  job  aids  to  enhance  performance  by  elimi¬ 
nation,  where  appropriate,  of  the  need  for  extensive  recall. 

3.  Emphasize  use  of  training  manager  instructional  job  packages. 

4.  Continue  to  expand  "hands-on"  training  in  officer  and  NCO  basic 
courses  so  that  the  graduates  will  have  competency  in  the  tasks  they 
supervise. 

5.  Initiate  a  program  of  periodic  train-up  for  selected  skills  such 
at  63C/H  mechanics,  05C  radio  operators,  tank  commanders  and  gunners  by 
use  of  comprehensive  exportable  training  packages  which  emphasize  job  aids 
and  which  are  designed  for  use  by  officer  and  NCO  unit  trainers. 

6.  Establish  a  more  feedback  system  to  communicate  training  needs 
between  users  and  the  training  base. 

7.  Prepare  program  and  resource  estimates  by  1  Feb  79  for  inclusion 
in  PARR. 

CONCLUSION: 

There  is  a  need  to  develop  rapid  train-up  materials  and  other  training 
support  materials  for  the  RC  and  early  deploying  AC  units. 

RECOMMENDATION:  PRIORITY  2 

TRADOC:  -  Develop  rapid  train-up  materials  for  high  density  combat, 
combat  support,  and  combat  service  support  MOS  critical  tasks  in 
accordance  with  the  general  ISD  model.  Based  on  TEA  '78  results,  priority 
should  be  given  to  MOS  19E/F,  63C/H,  16P  in  that  order.  Additional  study, 
however,  may  be  required  to  determine  needs  of  other  MOS  critical  to  the 
Army's  warfighting  capability. 

CONCLUSION: 

Experiential  learning  techniques  such  as  REALTRAIN  appear  to  supple¬ 
ment  effectively  current  conventional  training.  MILES  and  NTC  develop¬ 
ment  should  be  intensified. 


RECOMMENDATIONS :  PRIORITY  3 


1.  DA  continue  intensified  efforts  to  develop  a  National  Training 
Center . 

2.  MACOMS  place  command  emphasis  to  encourage  use  of  REALTRAIN  and 
follow-on  hit/kill  simulation  devices. 

OBSERVATIONS: 

Recognizable  trends  emerging  across  the  sample  of  tests  serve  to 
reinforce  intuition  and  professional  judgments  that  the  competence  of 
those  in  leadership  positions  is  vital  to  collective  proficiency.  For 
this  reason  the  focus  of  training  concepts  and  directives  should  rest  on 
training  of  the  trainers.  Such  a  focus  could  be  initiated  by: 

-  conduct  of  performance  testing  at  the  top  first,  i.e.,  emphasize  SQT 
testing  at  SL4  and  3  and  initiate  comparable  testing  of  commissioned 
officers.  Leaders  should  have  competency  in  the  tasks  they  supervise. 

-  Rely  on  unit  officers  and  NCO 1 s  to  train  and  assess  the  proficiency 
of  SL  1  and  2  personnel. 

Initiate  second  generation  "How  to  train"  manuals  through  implementa¬ 
tion  of  training  to  collective  tasks  emphasizing  training  drills  and 
battle  drills.  Instructions  should  focus  on  how  to  optimize  multiechelon 
integrated  training  in  conjunction  with  training  program  variations 
generated  by  the  BTM  to  more  precisely  meet  requirements  of  individuals 
units . 

Implement  a  policy  of  stabilizing  combat  vehicle  crew  commanders  and 
gunners  as  teams  in  their  assigned  units.  Consideration  should  also  be 
given  to  whole  crew  stabi  1  izat ion.  The  study  group  was  unable  to  gain 
insights  into  the  results  which  reasonably  could  be  expected  from  this 
course  of  action  because  the  effect  of  drivers  and  loaders  on  crew  gunnery 
proficiency  was  not  measured.  It  does  appear,  however,  to  be  a  reason¬ 
able  course  of  action,  and  a  test  to  determine  actual  effects  of  such 
stabilization  has  been  included  in  the  TEA  '79  program. 

Lower  mental  category  soldiers  were  shown  to  be  trainable  in  the 
institution.  It  appears,  that  a  training  environment  dedicated  to 
training — i.e.,  well  organized,  planned,  implemented  by  off icers/NCO ' s 
competent  in  the  subjects  they  teach  and  in  teaching  and  training — is 
required.  Further,  observations  by  ARTS  members  indicate  that  the 
training  environment  should  be  less  encumbered  by  distractors  such  as 
schedule 


changes,  personnel  absent  from  training  and  the  lLke  in  order  to  ensure 
that  the  training  can  be  focused  to  achieve  the  desired  performance. 
Freedom  from  distractors  is  especially  important  as  there  is  less  "margin 
for  error"  in  training  the  lower  mental  category  soldier  to  proficiency. 
These  are  the  soldiers  who  were  in  the  majority  in  most  test  samples. 

Where  unit  training  programs  did  not  meet  these  prerequisites,  performance 
to  existing  standards  of  proficiency  was  seldom  attained. 

APPENDICES: 

1.  TEA  '78  Management  System  Package 

2.  Test  Synopsis 


ANNEX  A  -  TEA  ’78 


EARLY  ON  ...  A  NEED  WAS  IDENTIFIED 

FOR  A 


PROGRAMS  -  COMBAT 

RESOURCES  EFFECTIVENESS 


1.  PURPOSE:  The  purpose  of  this  Annex  is  to  expand  on  selected  aspects 
of  TEA  '78. 

2.  PURPOSE  AND  SCOPE  OF  TEA  ’78:  As  discussed  in  the  basic  document,  the 
purpose  of  TEA  '78  was  originally  to  collect  data  from  both  the 
institution  and  the  unit  on  selected  combat,  combat  support,  and  combat 
service  support  pacing  systems  and  Military  Occupational  Specialities 
(MOS).  The  initial  data  collected  was  to  be  used  to  assist  in  answering 
questions  posed  by  the  ARTS  Model  and  to  verify  relationships  established 
in  the  model.  As  the  ARTS  focus  narrowed,  the  need  for  higher  resolution 
data  to  replace  survey  derived  data  factored  into  the  Battalion  Training 
Model  (BTM)  served  to  place  increased  emphasis  on  the  successful  conduct 
of  TEA  '78  testing.  TEA  ’78  collected  data  from  both  the  institution  and 
unit. 
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ARMY  RESEARCH  INSTITUTE 


TEA1 
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FORSCOM 
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a.  ARTS.  The  role  of  the  study  group  was  to  coordinate  the  conduct 
test  initiatives  prepared  by  each  proponent  TRADOC  school.  TRADOC  schools 
were  assisted,  as  appropriate,  by  various  analytical  agencies.  Once 
begun,  TEA  '78  was  passed  from  ARTS  to  the  schools  for  execution.  As  the 
study  narrowed  and  the  need  for  high  resolution  TEA  '78  data  become  more 
important,  ARTS  staff  officers  were  charged  with  upgrading  the  TEA  '78 
program  and  with  coordinating  all  aspects  of  the  testing  and  data 
collection  to  ensure  the  timely  collection  of  high  quality  data.  The 
system  devised  to  manage  TEA  '78,  the  ARTS  TEA  '78  management  system 
package,  is  at  Appendix  1  to  Annex  A. 

1  DWT  -  Division  Work  Team.  Formed  with  each  participating 
division.  No.rmally  overwatched  by  the  Division  Chief  of  Staff. 

SWT  -  System  Work  Team.  Formed  with  each  TRADOC  school.  Chaired 
by  the  school  commandant  or  his  representative. 


b.  Division  Work  Team  (DWT).  This  team  was  formed  within  each 
division  which  supported  ARTS.  These  teams  participated  in  the  planning 
for  TEA  '78  tests  and  in  making  requested  troop  units  and  support 
available. 

c.  System  Work  Team  (SWT).  These  teams  were  formed  at  each 
participating  TRADOC  school  and  were  chaired  by  the  school  Commandant  or 
his  representative.  The  SWT  was  responsible  for  the  development  of  the 
recommended  study  approach  for  weapons  system  and/or  MOS  for  which  the 
school  has  proponency.  Team  members  then  prepared  study  plans  and 
coordinated  the  conduct  of  testing. 

d.  Members  of  the  scientific  community.  Support  to  the  study 
group  was  provided  by  the  scientific  community.  Examples  of  the  type 
support  provided  Includes: 

(1)  Army  Research  Institute:  Participated  in  the  development  and 
conduct  of  various  tests,  data  reduction,  and  the  revision  of  school  test 
plans.  (Examples:  Tank  Crew  Tbrbulence  Test,  Anti-Armor  REALTRAIN). 

(2)  Combat  Development  Experimentation  Center:  Provided 
professional  support  throughout  the  study  and  provided  troop  units  to 
conduct  portions  of  the  tank  crew  moduler  training  program. 

(3)  TRADOC  Systems  Analysis  Agency:  Participated  in  the 
development  and  conduct  of  various  tests  (Examples:  Redeye  Engagement 
Test,  modified  M60A1  WSTEA) . 

(4)  Combined  Arms  Training  Developments  Agency:  Participated  in 
the  development  and  conduct  of  various  tests.  (Example:  Computer 
Assisted  Map  Manuever) . 

(5)  TRADOC  Concepts  Analysis  and  Test  Agency:  Participated  in  the 
development  and  conduct  of  various  tests  (Example:  several  infantry 
tests) . 

(6)  Concepts  Analysis  Agency:  Provided  analytical  support. 

(7)  Operational  Tests  and  Analysis  Agency:  Provided  Information 
about  operational  testing  procedures. 

e.  Importance  or  BTM.  The  prototype  BTM  is  using  survey  derived  data 
to  describe  the  ARTS  model  to  the  computer.  Survey  respondents  provided 
their  judgments  as  to  the  length  of  instructional  periods  and  frequency 
required  to  train  to  individual  SM  and  unit  proficiency  on  collective 
tasks  and  ARTEP  missions.  The  integration  of  the  resulting  "required" 
hours  within  available  training  hours  is  done  by  the  BTM  in  a 
pre-processing  module.  The  Integrated  (reduced)  program  is  then  included 
in  the  annual  battalion  training  program. 


High  n  lot  ion  data  fnr  field  testing  is  ;  1  t  1  r :  a  r  *■  1  y  to  be  used  m 
rt  rlue  this  survey  derived  data  in  the  BTM.  As  previous  !  y  cent  1 .  ne  i ,  TKA 

'7b  was  upgraded  to  collect  sotr.e  of  this  data.  A  copy  of  the  TEA  '78 

Management  Package  which  details  this  upgrading  effort  is  attached  at 

Appendix  1  of  Annex  A. 

Tata  produced  by  TEA  '78  will  be  placed  in  data  bank  from  which  it  .an  be 

withdrawn,  as  needed,  to  be  used  in  the  ETM. 


TEA  METHODOLOGY 
TRAINING  TECHNOLOGY  TRAINING  PROGRAMS 
UPDATE  THE  BATTALLION  TRAINING  MODEL 


In  addition  to  supporting  the  BTM,  future  TEA  results  will  be  used  to 
improve  7EA  methodology,  training  techniques,  and  training  programs. 


f.  Development  of  methodology  for  TEA  ’85.  Lessons  learned  in  the 
development  of  TEA  were  applied  to  the  TEA  ’85  program.  This  program  is 
designed  to  ensure  the  timely  effective  assimilation  of  new  weapon 
systems,  equipment,  and  MOS  into  the  Army.  TEA  ’85  is  discussed  in  the 
basic  document  as  well  as  in  Annex  B,  TEA  ’85.  Many  concepts  in  TEA  ’85 
grew  cut  of  TEA  ’78.  It  was  quickly  seen  that  trainability  must  be 
ensured  prior  to  the  making  of  a  production  decision  and  that  adequate 


training  subsystems  must  he  provided  apai  e  with  procurement  if  tin 
potential  inherent  in  modernization  of  the  Army  is  to  be  realized.  As 
APTS  progressed,  it  became  clear  that  certain  objectives  applied  to  all 
tests.  These  objectives,  termed  cure  objectives,  were  developed  as  a 
result  of  deliberate  con s 1 der a t  1  on  of  the  challenge  of  obtaining  data  so 
that  t  raining  to  an  optima!  level  of  pro  fit  iem  v  could  be  accoir.pl  i  shed . 

I  r.e  core  objectives  and  accompanying  situational  variables  which  were 
!-vel,  fed  :  be  oed  in  various  combinations  with  selected  test*  ,  became 

t !  e  basis  f  r  the  lhA  '85  methodology.  A  c  ornp  rehe  n  s  l  ve  TKA  '85  test  plan 
w  n  ;  h  include1,  tests  directed  at  developing  systems  as  well  as  resource 
component  and  training  base  related  problems  was  prepared. 


Management  System 
1  as  in  raragraih 


This  s.s'em  is  discussed  in  the  basic- 
la  of  this  Annex.  The  1  PA  '78  Managen.t-n 


n  is  at  A : 

r*  • 

:  1  :  x  !  . 

fives  a  n d 

<  »• 

1  e  c  t  e  d  s 

t  the  m.a r a 

•  •  t  s  v  s 

s  v  no po  s 

1  * 

of  test 

It  is  sufficient  to  sjv  here  that  TP  A  'S'1  core 
tuat  icons  variables  were  factored  into  TKA  1  ’8  b 


t  test  results  1  Pee  Appendix  2 1  . 


TEA  DATA  ' 
.  COLLECTION. 


LIMITED  BY 


ADD  ONS  -  TO  PREVIOUSLY 
SCHEDULED  TESTS 


QUICK  RESPONSE  TESTING 


TEA  '78  TESTS 


The  program  included  testing  on  the  following  pacing  systems  and  MOS. 
Tests  provided  data  across  the  ARTS  Model  from  resources  to  combat 
effectiveness.  Synopses  of  these  tests  are  at  Inclosure  2.  Tests  from 
this  series  that  have  not  been  completed  have  been  transferred  to  TEA  '79. 

a.  M60A1  tests  were  conducted  by  the  Armor  Center,  TRASANA,  and  ARI, 
and  were  sponsored  by  the  Armor  Center  SWT.  A  comprehensive  series  of 
tests  were  planned  and  conducted  which  included  research  into  the  effects 
of  turbulence,  proficiency,  and  retention;  the  relationship  of 
institutional  training  for  entry  level  personnel  on  unit  proficiency; 
rapid  traln-up  programs  for  reserve  units  and  the  application  of  ARTS  TEA 
'85  concepts  to  the  XMI  OT  II.  Reserve  Component  and  tank  subcaliber 
tests  have  been  transferred  to  TEA  '79. 

b.  Extensive  Redeye  testing  was  conducted  to  determine  costs, 
appropriate  training  programs,  performance  decay  over  time,  and  to  define 
interoperability  impacts  of  US  programs  in  other  nations.  In  addition, 

TEA  '85  core  and  situational  variables  concerning  learning  decay,  varying 
the  institutional  and  unit  training  mix,  the  effects  of  turbulence,  and 
development  of  exportable  training  packages  for  reserve  units  were 
investigated.  A  methodo-ugy  to  input  variable  levels  of  proficiency  into 
the  CUMO  III  v;ar  model  to  determine  combat  effectiveness  (CE)  as  a 
function  of  training  was  also  developed. 

A  series  of  ongoing  and  scheduled  TOW  TEA  tests  being  conducted 
for  and  by  the  Infantry  school  were  incorporated  into  TEA  '78  to  determine 
the  cost  to  train  in  the  institution;  the  cost  to  train  Active  and  Reserve 
Component  TOW  crews  and  the  cost  to  implement  improved  TOW  vehicle  (ITV) 
training.  Additional  subtasks  were  planned  to  compare  institutional  and 
unit  training  alternatives  and  to  correlate  TOW  trainer  scores  with  live 
fire  scores  and  gunner  selection  criteria  models.  TRASANA  supported  the 
Infantry  School  in  relating  gunner  proficiency  levels  to  combat 
effectiveness  by  use  of  war  models.  While  these  tests  have  been  largely 
concluded,  final  reports  have  yet  to  be  approved.  For  this  reason,  this 
series  of  tests  has  been  transferred  to  TEA  '79. 

d.  Testing  of  forward  observers  ( FO)  included  research  into  the 
relation  between  the  FO  and  unit  training  programs;  the  impact  of  expanded 
use  of  the  observed  fire  trainer  on  FO  proficiency,  and  the  suitability  of 
exported  FO  training.  These  tests  are  still  ongoing  and  have  been 
transferred  to  TEA  '79. 


e.  Tests  of  63C/H  personnel  Included  the  development  of  proficiency 
profiles  from  entry  level  training  through  grade  E-7  to  include 
performance  decay  curves.  Reserve  Component  training  programs  were  also 
investigated. 

f.  Tests  of  05C  personnel  evaluated  the  effectiveness  of  the 
self-paced  program.  A  proficiency  comparison  was  made  of  05C  teams  in 
units  which  had  been  trained  in  self-paced  and  in  group  trained  courses. 
Alternative  unit  training  programs  were  compared  to  determine  optimum 
programs  to  correct  performance  deficiencies. 

Add-on-Testing 

As  a  part  of  the  TEA  upgrading  effort,  a  concentrated  effort  was  made 
to  incorporate  data  from  ongoing  tests  into  TEA  '78.  Data  have  been 
received  from  Rifle  Squad  REALTRAIN,  Anti-Armor  REALTRAIN,  and  Computer 
Assisted  Map  Maneuver  (CAMMS)  testing  designed  to  generate  proficiency 
profiles  on  command  groups.  Other  tests  from  which  data  will  be  received 
in  the  future  as  part  of  the  TEA  '79  program  include  the  training 
instrunentation  evaluation  (TIE)  test,  ARI  studies  on  cannon  crew  turnover 
and  tests  on  the  retention  and  proficiency  of  common  Field  Artillery  AIT 
skills,  and  TACFIRE  OT  III. 

TEA  '78  testing  included  the  collection  of  biographical  data,  history 
of  institutional  and  unit  training,  and  the  specific  costs  of  this 
training.  In  addition,  concerted  efforts  were  made  to  determine  skill 
retention.  Research  of  available  literature  was  integral  to  all  tests. 
Test  objectives  were  designed  to  establish  correlations  between  selected 
variables  and  job  performance  (i.e.  hits  as  a  function  of  stability, 
performance  as  a  function  of  experience  or  turbulence,  etc.). 

Append  lx : 

1.  TEA  '78  Management  System  Package 


2.  Test  Synopses 


Appendix  1  to  Annex  A 
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TRAINING  EFFECTIVENESS 
ANALYSIS  1978 


DEPARTMENT  OF  THE  ARMY 

HCAOQUAJTOS  US  A*MY  TtAININO  STUDY 
rO(T  lELVOtR.  VIRGINIA  22060 


ATCG-ATS  10  April  1978 

SUBJECT:  Revised  Army  Training  Study  (ARTS)  TEA  78  Management 

System  Package 


SEE  DISTRIBUTION 


1.  References: 

a.  Training  Developments  Study  Directive:  Army  Training 
Study  (ARTS),  dated  6  Oct  1977. 

b.  Director,  ARTS  Letter  of  Transmittal,  TEA  85,  dated 
13  Jan  1978. 

c.  Director,  ARTS  Letter:  Army  Training  Study  (ARTS)  TEA 
78  Management  System,  dated  5  April  1978. 

2.  At  Inclosure  1  is  the  revised  ARTS  TEA  78  Management  System 
Package.  This  package  reflects  the  changes  that  were  made  in 
reference  c  as  a  result  of  visits  of  ARTS  staff  members  to 
TRADOC  proponent  schools. 

3.  At  Inclosure  2  is  a  summary  of  all  changes  as  coordinated  wit 
and  agreed  to  by  the  TRADOC  proponent  schools.  Corrections  have 
been  made  to  include  changes  proposed  for  each  test. 

4.  ARTS  will  devote  increased  study  effort  to  analysis  of 
evidence  that  can  be  derived  from  test  activities  in  TEA  78. 
Validity  of  the  TEA  78  test  results  is  essential  to  the  evolu¬ 
tion  of  the  Battalion  Training  Model.  ARTS  will  drive  hard  to 
assist  both  testers  and  supporting  test  units  in  ensuring  a 
quality  effort.  We  solicit  the  active,  aggressive  support  of 
systems  work  team  members,  analysts,  testers,  testees  and  the 
multitude  of  people,  soldiers  and  civilians  alike  who  have 
already  contributed  so  much  to  ARTS. 


ATCG-ATS  10  April  1978 

SUBJECT:  Revised  Army  Training  Study  (ARTS)  TEA  78  Management 

System  Package 

5.  Questions  concerning  any  aspect  of  this  package  should  be 
referred  to  ARTS  staff.  POC :  LTC  Bloedorn  and  LTC  Stone, 
Autovon  354-1461/1462/1463/1464 


2  Inc  1 

1.  Revised  TEA  78 
Mgt  Sys  Package 

2.  MFR :  TEA  78  Tests 

DISTRIBUTION: 

2-Ea  SAG  Attendee 
1-Ea  TEA  Consultant  Gp  Mbr 
1-Ea  Ed/Tng  Consultant  Gp  Mbr 
1-Ea  Cost/Res  Mgt  Consultant  Gp  Mbr 
1-Ea  SWT 
1-Ea  ARTS  LNO 


ATCG-ATS  5  April  1978 

SUBJECT:  ARMY  TRAINING  STUDY  (ARTS)  TEA  ’78  MANAGEMENT  SYSTEM 


1.  REFERENCES: 

a.  Training  Developments  Study  Directive:  Army  Training 
Study  (ARTS)  dtd  6  Oct  1977. 

b.  Director,  ARTS  Letter  of  Transmittal,  TEA  '85,  dtd  13 
Jan  1978. 

2.  The  purpose  of  this  memorandum  is  to  describe  the  ARTS 
system  of  managing  the  near-term  study  effort.  Training  Effec¬ 
tiveness  Analysis  (TEA)  '78.  This  management  system  is 
designed  to: 

a.  Coordinate  TEA  '78  field  testing  and  research  with  other 
ongoing  Army  tests  so  that  meaningful  data  from  all  tests  will  be 
available  to  ARTS  analysts. 

b.  Provide  a  common  report  format  which  will  facilitate 
analysis  of  the  entire  short  term  study  effort  in  terms  of  the 
ARTS  model,  essential  elements  of  analysis  and  the  long  term 
study,  TEA  '85. 

c.  Provide  a  "crosswalk"  between  TEA  '78  objectives  and  test 
activities  and  the  core  objectives  and  situational  variables  of 
the  long  term  study,  TEA  '85. 

3.  TEA  '78  combined  with  the  long  term  effort,  TEA  '85,  form 
a  TEA  program  which  has  been  designed  to  quantify  the  current 
training  system  in  order  to  justify  allocation  of  required 
training  resources.  Additionally,  this  program  should  develop 
insights  leading  to  training  system  improvements  designed  to 
provide  an  Army  trained  to  win  not  just  the  first  but  rather 
all  battles  of  the  next  war. 

4.  Concept:  The  TEA  '78  management  system  provides: 

a.  A  summary  listing  of  all  tests  currently  included  in  TEA 
'78  and  additional  tests  that  appear  to  provide  information  which 
will  upgrade/validate  data  gathered  in  TEA  '78  tests. 

b.  Work  sheets  for  each  system  work  team(SWT).  These 
work  sheets  outline  test  objectives,  sample  sizes,  links  to 
the  ARTS  model,  major  test  activities  and  scheduled  reporting 
dates.  The  work  sheets  are  designed  to  facilitate  action 
officer  coordination  of  ARTS-related  efforts.  They  can  also 
be  used  to  trace  the  progress  of  field  testing  of  those  add-on 
tests  which  can  be  used  in  conjunction  with  SWT  Study  Plans. 
Recommendations  concerning  other  ongoing  tests  which  might 
support  ARTS  objectives  are  solicited.  Work  sheets  are  at 
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ATCG-ATS  5  A?:  i  ;  19  78 

SUBJECT:  ARMY  TRAILING  STUDY  (ARTS)  TEA  '78  MANAGEMENT  SYS7EV 

I  r.  closure  1. 

c.  TEA  '78  ARTS  Deliverable  Summary  Sheet.  Attached  to 
each  test  work  sheet  is  a  deliverable  summary  sheet  which 
portrays  the  separate  test  activities  in  relation  to  various 
areas  of  training  interest,  i.e.,  training  in  the  institution 
(Tj),  individual  training  in  the  unit  largely  to  Soldier's 
Manual  tasks  (T_)  or  collective  training  in  the  unit, 
primarily  to  ARtEP  tasks  (T.) .  These  activities  are  also 
arrayed  to  portray  their  interface  with  TEA  '85  core 
objectives  and  situational  variables.  Used  in  conduction  with 
reference  lb,  these  test  activities  are  to  be  used  in 
transition  to  testing  designed  to  support  long  term  study- 
efforts.  Further,  the  Deliverable  Summary  Sheet  portrays  the 
TEA  '73  interface  with  ongoing  ARTS  efforts.  Deliverable 
Summary  Sheets  are  attached  to  work  sheets  at  Inclosure  1. 

d.  The  reporting  handbook  attached  at  Inclosure  2  has 
been  prepared  to  assist  in  arraying  test  data  results  and 
conclusions  by  ARTS  area  of  interest  within  the  ARTS  model. 
Further,  the  handbook  provides  guidance  to  ensure  that  data  is 
delivered  in  such  a  manner  that  it  is  readily  available  to  TEA 
'85  testers  and  those  ARTS  personnel  developing  the  Battalion 
Training  Model. 

e.  ARTS  Training  Resource  Methodology,  attached  at  Inclos¬ 
ure  3,  will  continue  to  be  a  guideline  for  the  collection 

of  resource  data  for  the  development  of  insights  concerning 
the  relationships  between  resources  and  training  conducted 
both  in  the  institution  and  in  the  unit. 

4.  At  Inclosure  4  is  an  extract  of  the  TEA  '85  program, 
reference  lb,  showing  the  core  objectives,  situational 
variables,  test  concepts  and  the  TEA  '85  master  test  plan. 

This  extract  should  be  used  in  conjunction  with  the  TEA  '78 
independent  evaluation  plans  to  ensure  that  data  deriving  from 
TEA  '78  test  activities  which  will  be  needed  for  execution  of 
TEA  '85  and  other  study  efforts  (Battalion  Training  Model)  is 
captured  and  included  in  all  reports  to  ARTS. 

5.  ARTS  POC  are  visiting  each  SWT  to: 

a.  Review  work  plans  and  progress. 

b.  Assist  in  arranging  technical  support  as  appropriate. 

c.  Discuss  report  guidelines  to  identify  necessary  changes 
to  the  final  procedures  described  in  the  reporting  handbook  (In¬ 
closure  2).  These  guidelines  encompass  how  tests  will  relate  to 
the  APTS  Model,  objectives,  EEA ,  and  situational  variables,  and 
subsequent  ARTS  excursions. 


ATCG-ATS  5  April  1978 

SUBJECT:  ARMY  TRAINING  STUDY  (ARTS)  TEA  '78  MANAGEMENT  SYSTEM 


6.  ARTS  POC's  for  the  administration  of  this  system  are: 

a.  LTC  G.  W.  Bloedor n  &  LTC  T.  Stone  AV  354-1461/62/63 
M60A1 

MOS  63/C,  H 
CAMMS 
XM-1  OT  II 
REALTRAIN 
TIE  TEST 

GENERAL  SURVEY  ON  TRAINING  REQUIREMENTS 

b.  LTC  P.  Zielenski  AV  354-1461/62/63/64 
ARTY  FO  13  F  Exported  Tng 

ARI  CANNON  CREW  Turn-over 
T AC FI  RE  Post  OT  III 
REDEYE 

AIT  COMMON  SKILLS  RETENTION  -  13B 

c.  LTC  W.  Valen  AV  354-1461/62/63/64 
TOW 

11B  P4 
05C 


Deliverable  Summary  Sheets  Director 

2.  Reporting  Handbook 

3.  ARTS  Training  Resource  Methodology 

4 .  TEA  ' 85  Extract 


SWT  WORKSHEETS  AND  ARTS 


DELIVERABLE  SUMMARY  SHEETS 


ANNEXES: 

A.  M60A1 

B.  REDEYE 

C.  TOW 

D.  FO 


E.  63C/H 

F.  05C/F 

G.  ADD-ON  TESTS 
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Variable  2tf:  Develop  training  concept  to  pro¬ 
ficiency  with  reduced  resrxirces. 
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Paths  Through  There  are  two  or  more  bridges  between  each  block  of  the  ARTS 
ARTS  Model  model.  They  are; 
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Paths  Within  TRAINING  PROFICIENCY 

the  Blocks  Individual  proficiency 

(continued)  Collective  proficiency 
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Looping  Through  If  a  test  encompasses  both  institutional  and  unit 

Model  training  programs  in  effect  it  is  looping  back 
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Problems?  If  problems  are  encountered  usinq  these  instruct  ions  for 

preparing  reports  call  ARTS,  Aufovon  3S4-1461 


ARTS  TRAINING  RESOURCE  METHODOLOGY 


1.  PURPOSE 

Provide  SWT  guidance  for  collecting  data  for  me  devel¬ 
opment  of  relationships  between  resources  and 
training  conducted  both  in  the  institution  and  m  me  unit. 

2.  GROUND  RULES 

A.  Training  resources  are  time,  personnel,  and  dollar  ( FY7B ) 
costs . 

B.  In  SWT  investigations  which  involve  a  coirpar  ison  of 
training  alternatives  the  status  quo  will  be  included  as  one  of 
the  alternatives  in  ord*r  to  establish  a  baseline.  One  time  cost 
and/or  savings  associated  with  an  investigation  of  alternative 
unit  training  strategies  will  be  identified. 

C.  Tj  resource  requirements  will  be  provided  to  SWT  by  HQ 
TRADOC  ( DCS RM)  using  the  methodology  contained  in  TRADOC  Reg  11-5 
and  associated  cost  analysis  studies  of  ATCs  and  schools.  SWT 
input  requirements  tp  HQ  TRADOC  for  costing  alternative  Tj  pro¬ 
grams  are  at  TAB  A. 

D.  FORSCOM/DWT  in  coordination  with  SWT  is  requested  to  de¬ 
termine  the  resource  impact  on  unit  training  as  a  result  of  any 
transfer  of  institutional  training  to  unit  training  using  TS/TA 
ARTS  resource  methodology  ( ATRM } . 

E.  Resource  data  collected  for  ARTS  snould  reflect  tne 
training  resource  requirements  for  the  training  program  (s'  (cr 
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portions  thereof)  which  are  being  investigated  by  APTS  with  ■  3- 
scect  to  training  proficiency.  For  example,  if  a  specific  por¬ 
tion  of  a  tank  crew  training  program  is  being  evaluated  wifh 
respect  *-o  a  pertinent  measure  of  crew  proficiency,  resource  data 
collected  should  reflect  the  cost  of  that  portion  of  training  a 
tank  crew  rather  than  the  cost  of  the  complete  program  for  train¬ 
ing  a  tank  crew.  The  cost  of  the  complete  program  for  training  a 
-ar.k  crew  would  be  relevant,  however,  if  the  entire  program  was 
being  reviewed  with  respect  to  the  over  a  1 1  proficiency  of  a  tank 
crew. 

3 •  METHODOLOGY 

A.  SWT  are  responsible  for  determining  which  investigations 
of  training  programs  (or  portions  thereof)  under  their  review 
will  be  suppor  ted  with  training  resource  requirements  data.  Al¬ 
though  the  level  of  resolution  of  relating  resources  to  training 
is  dictated  by  the  particular  insights  being  sought  by  a  SWT,  the 
maximum  levels  of  aggregation  of  data  are: 


(1) 

Tr  by 

cour 

se 

graduate . 

(2) 

Total 

TS1 

by 

MOS  and  skill 

level  per  soldier  . 

(3) 

rot  a  1 

TS2 

by 

MOS  and  skill 

1  eve  1  per  soldier. 

(4) 

Total 

tai 

by 

separate  unit 

level,  i.e.,  crew/sguad/ 
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and  battal ion 
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(5) 

Total 

TA2 

by 

separate  unit 

level.  Formats  for 
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TI ' 
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and  resource  da*-a  are  at 
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espec‘  i 

vely.  Tgj  and 

’Tg2  use  3  common 

af  as  does  T^ 

and 

TA2 

Iv  is  acknowledged  ‘hat  some  SWT 

inve s t iga t  ions  will  require  resource  data  to  be  collected  for 
only  a  portion  or  segment  of  Tg^,  Tftj,  etc.  The  tank  crew 
example  in  paragraph  2F  illustrates  this  point  for  Tft'  while  the 
examples  given  in  the  next  paragraph  illustrate  different  por¬ 
tions  of  Tg  for  which  resources  may  be  collected. 

B.  The  total  individual  training  program  in  a  unit  for 
a  particular  MOS  &  skill  level  may  be  divided  and  subdivided 
into  meaningful  subsets  of  training  programs  which  are  mutually 
exclusive  and  totally  exhaustive.  Tg^  may  be  addressed  in 
any  of  a  number  of  ways  depending  upon  the  intended  use  of  the 
data  . 

(1)  All  formally  scheduled  instruction  (Total  Tgj  or 

TTS1)  includes  Soldier's  Manual  (SM)  tasks,  as  well  as  non-SM- 
tasks  instruction  which  is  required  for  the  development  of  a 
"whole  soldier."  Human  relations  and  defensive  driving  are 
examples  of  non-SM-task  instruction. 

(2)  Divide  Total  Tg^  into  two  subsets;  all  instruction  on  SM 
tasks  (SM  Tg^,  and  remaining  instruction  devoted  to  non-SM-task 
instruction  (NSM  Tg^). 

(3)  Subdivide  SM  Tg^  into  subsets  so  that  each  subse*-  ad¬ 
dresses  a  relevant  grouping  of  SM  tasks.  Relevant  groupings  of 
SM  ‘asks  for  11B10  would  be  those  grouped  in  FM7-11P1  by  Section 
(e.g.,  Battlefield  Survival,  Combat  Techniques,  etc.)  or  by 
Subsection  (Subsections  within  the  Combat  Techniques  Section 
address  Basic  Individual  Techniques,  Land  Navigation,  Communi- 
C3‘ ions,  etc.)  or  by. ...The  subdivision  may  continue  *o  the 
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print  'hat  a  multiple  subdivision  of  Tgj  is  addressing  train¬ 
ing  relating  to  one  sub-task  of  a  specific  SM  task.  The  point 
being,  data  should  be  collected  which  reflects  (defines)  only  tha 
particular  training  which  contributed  to  the  proficiency  being 
measured. 

C.  The  treatment  of  time  with  respect  to  the  categories  of 
training  is  a$  follows: 

(1)  The  time  available  for  a  unit  to  eor.duc*  formally 
scheduled  training  is  recognized  as  a  constrain*-.  For  the  pur¬ 
pose  of  this  analysis,  this  constraint  is  set  at  1848  hours  (48 
weeks  x  5  day/weeky8  hours/day  -  9  holidays  x  8  hours/day) .  This 
1848  hours  is  distributed  between  Tg^,  ,  T^*  and  TN . 

Tn  is  the  time  devoted  to  non-training  activities  such  as  guard, 
detail,  training  support,  demonstr at  ions ,  etc.,  all  of  which 
compete  for  a  chunk  of  the  1848  hours. 

(2)  Tg 2  does  not  compete  for  any  of  the  1848  hours  as  it 
is  training  conducted  at  times  other  than  when  training  is  for¬ 
mally  scheduled.  Tg  2  niay  be  after  duty  hours  time  or  slack 
time  during  normal'  duty  hours,  and  therefore,  is  viewed  as  bonus 
time  achieved  through  motivation  or  training  efficiencies. 
Although  Tg 2  is  not  competing  for  any  of  the  1848  hours,  the 
hours  expended  must  be  accounted  for  in  order  to  provide 
insinhts  on  TTg.  Dollar  costs  are  attributed  to  TS2  only 

for  the  unique  training  support  material  required  exclusively 
for  Tg^.  Guidance  on  assigning  costs  to  such  materials  will 
be  provided  on  a  case-by-case  basis  as  SWT  identify  the  unique 
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training  materials  in  the  course  of  their  investigations. 

(3)  E  is  considered  to  be  restricted  to  individual  unit 
training  conducted  during  time  formally  allocated  to  Tft;'and 
therefore,  it  is  addressed  in  the  same  manner  as  outlined  above 
for  Tg2-  It  is  acknowledged  that  training  on  particular 
individual  tasks  may  be  formally  transferred  from  Tg-j_  to  E, 
and  thus,  this  training  efficiency  frees  a  given  number  of 
Tgj  hours  for  reallocation  to  other  Tg^  training  or  for 
reallocation  to  Tft.  An  example  of  a  Tg^  training  event 
which  may  be  formally  transferred  to  E  is  the  preparation  of 
range  cards  by  tank  gunners. 

D.  The  collection  of  resource  data  for  Tgl  and  E  for 
a  given  MOS  and  skill  level  is  based  upon  the  TTgl>SM  Tgl  or 
subsets  of  SM  TS1  training  programs  to  be  investigated.  Data 
for  Ta1  are  collected  based  upon  the  particular  unit  level 
(crew,  platoon,  etc.)  program  or  particular  portion  of  a  unit 
level  program  to  be  investigated.  SWT  have  lead  responsibility 
of  identifying  the  detailed  content  and  "calendar  time  period" 
of  the  specific  Tgl  and  E  program  (or  portions  thereof)  as 
well  as  the  TAl  and  Ta2  programs  for  which  resource  data 
are  to  be  collected.  Requests  for  assistance  available  from 
ARTS  Consultant  Groups,  HQ  TRADOC,  HQ  FORSCOM,  HQ  USAREUR,  and 
DWT  should  be  made  through  the  ARTS  resource  point  of  contact, 
LTC  Michael  J.  Hatcher,  AV  354-1461. 

(1)  A  unit  will  have  a  given  unit  training  program  for 
each  MOS  by  skill  level  which  will  formally  allocate  a  soecifrc 
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number  of  the  1848  hoars  available  to  the  soldier  with 
that  given  MOS  and  skill  level.  The  program  is  different 
for  the  118  and  1 1 E ,  as  well  as,  for  the  11E10  and  the  11E20. 
Each  unique  program  (e.g.,  11E23)  will  consist  of  scheduled 
training  which  must  be  identified  as  SM  T^j,  or  NSM  Tg^. 

A  highly  structured  unit  training  program  may  even  have  indi¬ 
vidual  training  scheduled  during  a  time  period  scheduled 
primarily  for  .  Such  individual  training  must  be  identi¬ 
fied  as  E.  Additionally,  one  can  conceive  of  a  unit  having 
separate  collective  training  programs  for  each  level  of  collec¬ 
tive  training  (crew,  platoon,  company,  etc.).  An  example  of  a 
portion  of  a  hypothetical  training  program  is  at  TAB  E.  Such 
detailed  programs  do  not  exist  in  units;  however,  SWT  need  to 
construct  such  a  tool  for  an  aid  to  its  analysis.  The  level  of 
detail  of  the  program  constructed  by  the  SWT  is  dictated  by  the 
investigations  to  be  made.  The  ID#/Task  shown  on  TAB  E  relates 
to  the  ID#/Tasks  which  appear  in  the  HE  Soldier's  Manual  and 
the  Mech  Inf/Tank  Task  Force  ARTEP.  The  assigned  training 
categories  segregate  training  events  for  the  purpose  of  data 
collection.  The  training  events  within  a  given  category  should 
be  grouped  depending  upon  the  particular  investigation  a  SWT 
plans  to  make.  (See  Paragraph  3B) . 

E.  The  basic  building  blocks  for  the  collection  of  train¬ 
ing  program  data  are  the  specific  training  events  identified 

within  the  training  program  as  illustrated  at  TAB  E.  The  data 
* 

for  separate  events  may  be  aggregated  to  reflect  the  total 
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requirements  for  that  portion  of  the  training  program  for  which 

proficiency  is  to  be  measured.  The  resource  sensitive  data 

* 

elements  to  be  addressed  for  each  training  event  are: 

(1)  Equipment  usage  by  type  ( Ml 51,  Ml  13,  etc.)  to 
include  miles,  hours,  or  rounds. 

(2)  Ammunition  requirements  by  number  of  rounds  by  DODIC. 

(3)  Number  of  trainees  by  grade. 

(4)  Number  of  trainers  by  grade  who  physically  con¬ 
duct  the  training. 

(5)  Amount  of  trainee  time  and  trainer  time  allocated 
to  the  training.  Trainer  time  includes  preparation,  instruc¬ 
tion,  and  evaluation. 

(6)  TDY  ( EOE  2100)  and  transportation  ( EOE  2200) 
requirements  for  trainees  and  trainers. 

(7)  Training  aids/devices  utilized. 

(8)  Training  materials  and  special  supplies  consumed. 

F.  An  example  format  for  collecting  the  resource  data 
associated  with  a  particular  training  event  is  at  TAB  F. 

The  example  uses  ID#/Task  6-12,  Tank  Platoon  Battle  Fun  as 
shown  on  the  hypothetical  training  program  at  TAB  E.  As  an 
assistance  in  preparing  a  training  event  resource  da'ia  collec¬ 
tion  worksheet,  listings  of  vehicles,  weapons,  other  equipment, 
and  ammunition  associated  with  combat  and  combat  support  bat¬ 
talions  is  provided  at  TAB  G. 

G.  The  procedures  for  deriving  the  dollar  costs  of  a 
training  event  are  shown  at  Inclosure  1  to  TAB  F,  continuing 

7 


U-CGu'-'a.’ 


,  /,  /,  . 


J. 


with  the  Tank  Platoon  Battle  Ran  example  as  a  vehicle.  The 
format  for  the  costing  procedures  is  keyed  to  the  training 
resource  data  display  sheets  (TAP's  B,  C,  and  D) .  The  cost 
factors  necessary  for  estimating  costs  of  training  are  at 
the  following  TAB'S:  TA3  H,  Military  Personnel  and 
Allowances;  TAB  I,  Vehicle  Usage;  TAB  J,  Weapon  Usage;  TAB 
K,  Other  Equipment;  TAB  L,  Ammunition;  and  TAB  M,  Listing  of 
MACOM  Wide  Cost  Factors  for  Program  2  Mission  (Fixed), 
Program  2  Base  Ops  (Variable),  and  Program  2  Base  Ops 
(Fixed).  Additionally,  guidance  for  locally  developing  the 
man  hours  associated  with  the  Battalion  Training  Management 
Personnel  is  included  at  TAB  N . 

4 •  ADDITIONAL  GUIDANCE 

The  above  guidance  should  cover  most  situations;  however, 
additional  guidance  is  available  from  your  ARTS  Resource 


SWT  Input  Requirements  Required  for  Costing  Alternatives  Tj  Programs 

1.  Course  title  and  number. 

2.  Name  of  installations  at  which  the  course  is  taught  and  any 
changes  to  be  addressed  under  the  alternative. 

3.  Current  length  of  course  expressed  in  weeks  and  days,  e.g., 

5  weeks  and  2  days  and  any  change  to  course  length. 

4.  Any  changes  to  types  of  instruction  (e.g.,  lecture,  PE, 
self-paced)  included  in  the  alternative  courses. 

5.  Ammunition  requirements  by  quantity  and  DODIC  for  the 
status  quo  and  alternatives. 

6.  Changes  in  tng  aids/devices,  quantity  by  item  (e.g., 

Bessler  Cue  See,  TV). 

7.  Revised  instructor  contact  hours. 

8.  Frequency  of  classes  per  year,  status  quo  and  alternative. 

9.  Changes  in  average  grade  of  instructors. 

10.  C.nanges  in  average  grade  of  students. 

11.  Changes  in  school  troop  requirements  expressed  in  additions 
or  decrements  of  man  days  of  support. 

12.  Any  changes  in  training  overhead,  e.g.,  school  brigade, 
office  of  Director  Training  Developments. 

13.  Changes  in  requirements  for  equipment  purchased  with 
Procurement  dollars. 

14.  Any  one  time  costs  by  OMA/MCA  for  the  modification  or 
construction  of  facilities. 

15.  Identify  additional  facilities  which  are  required  by  a  pro¬ 
posed  Tj  Program  to  include  the  source  of  those  facilities. 

16.  Identify  facilities  which  under  a  proposed  Tj  program 
will  become  available  for  an  alternative  use. 
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COURSE  TITLE: 

COURSE  NUMBER/MOS: 

DOLLARS  (PY78)  OMA  MAP  >PA 

Var table 

Program  8  Mission 
Instructional  Dept 
Other 

Program  8  TOE  Spt 
Ammunition 
Pay  k  Allowances 
Students 
All  others 

Travel  Pay  to  Course 
Per  Diem  at  Course 
Program  8  Base  Ops 

Support  Cost  (Tng  Aids)  _ _  _  _ 

TOTAL: 

Fixed 

Program  8  Mission 
Program  8  Base  Ops 
Program  8  TOE  Spt 

Support  Costs  (Tng  Aids) _  _  _ 

TOTAL: 

TOTAL  VARIABLE  k  FIXED  _  _  _ 

TIME/PERSONNEL: 

Student  Course  Length  _ 

Direct  Man  weeks  of  effort  of 

Instructional  Depts  &  School  Overhead.  Civ _  Mil _ 

TAB 
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Tg*  RESOURCE  REQUIREMENTS 


MOS  i  Skill  Level  : 


Authorized  Grade: 


Average  Pay  Grade  of  Personnel  Assigned  to  MOS  i  Skill  Level: 

Level  of  Resolution  of  Tg* .  (e.g.,  TTS ^ ,  -  SM  TS,  -  Combat  Teen  -  Basic 

Ind  Tech,  SM  IDl/TASK,  etc.  iSee  para  3D; 


DOLLARS  ( FY7  8 ) 


Var iable 


TOTAL 


Program  2  Mission 
(Equipment  usage) 

Amman i t ion 

Pay  t  Allowances 

TDY/Tr  ansportation 

Program  2  Base  Ops 

Training  Aids/Devices 

Training  Materials  i 

Special  Supplies  Consumed  _  _____  _  _ 

Fixed 

Program  2  Mission 

Program  2  Base  Ops  _  _  _  _ 

TOTAL: 

TOTAL  VARIABLE  i  FIXED: 

TIME/PERSONNEL 

"Calendar  time  period"  over  which  this  training  is  conducted,  (e.g.,  1  yr  , 

I  at  r 

Trainee  time  consumed  on  this  training.  (e.g.,  45  brs) 

Manweeks**  of  direct  effort  required  to  Spt  this  training.  _ 

Identification  of  unit  from  which  data  was  collected  _ 

*  Indicate  Tgj  or  T^- 

**  Also  may  be  expressed  as  man  hours  or  man  months,  which  ever  is 
most  meaningful  for  the  particular  svaa^ion. 


AP  C 


ta*  resource  requirements 


p 

UNIT  LEVEL:  (Crew,  squad,  section,  platoon,  company  or  tat t a J : on > 

TRAINING  ID*/TASK:  (Relate  to  ARTEP  ID#/TASK) 

DOLLARS  ( FY7  8 )  OMA  MPA  _ PA_  TOTAL 

Var iabl e 

Program  2  mission 
(Equipment  usage) 

Ammunition 

Pay  &  Allowances 

TDY/Tr anspor  tat  ion 

Program  2  Base  Ops 

Training  Aids/Devices 

Training  Materials  £ 

Special  Supplies  Consumed  _  _  _  _ 

Fixed 

Program  2  Mission 

Program  2  Base  Ops  _  _  _  _____ 

TOTAL: 

TOTAL  VARIABLE  &  FIXED: 

TIME/PERSONNEL 

Training  Unit  Time  (Unit  hours,  e.g.,  12  Platoon  hours) 

Man  weeks**  of  direct  effort  required  to  support  the  Tng:  _ 

Calendar  time  period  associated  wi*h  Tft  being  addressed:  (e.g.,  1  yr ,  1  qt 

Identification  of  Unit  from  which  data  was  collected.  _ _ _ 

*  Indicate  TAl  or  TA2 

**  Also  maybe  expressed  as  manhours  or  man  months,  which  ever  is 
most  meaningful  for  the  particular  situation. 


TAB  D 
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Compan y 

A 

Is* 

Bn,  5  3d 

Armor 

A ■ ,  ID#  'TASK  6- 

12,  Tank 

Pi  a  r non  Ba  •  *  1  e 

?c 

Trarnee  Pe 

r  sonne  1 

MOS 

GRADE 

AUTH 

ASSIGN:'  r 

‘■'AN  -  i'JPS 

llflO 

E-3 

5 

8 

1 1  E  1 0 

E-4 

5 

2 

- 

11E20 

E-4 

0 

2 

8 

11E20 

E-5 

5 

3 

;  2 

11E30 

E-5 

0 

1 

4 

1 1E30 

E-6 

3 

2 

s 

11E40 

E-6 

0 

1 

4 

11E40 

E-7 

1 

0 

0 

Trainer  Pe 

r  sonnel 

MOS 

GRADE 

AUTH 

ASSIGNED 

va.N  HOURS 

12A 

0-1 

1 

1 

3* 

*  Includes  4  hrs  preparation. 

Participating  Weapons 

WPN  CAL  AMMO  ] 

Tank  M60A1  TF5Fn~ 

MG,  Veb  Mtd  .  50cal 

MG,  Veb  Mtd  7.62mm 

Oher  Ec j ipme.nt  -  None. 


AVG  RD/WPN  A VG  MC/WFN 


TOY/ Transportation  -  None.  Note:  If  the  platoon  expended  TDY 
funds  ( EOE  2200)  or  transportation  funds  (EOE  2100;  to  travel  - 
a  live  fire  range,  these  costs  wojld  be  listed. 

Training  Aids/Devices  Used  -  None.  (If  any  such  materials  we:  € 
used  they  should  be  listed  to  include  usage  rates.  Costs  will 
be  provided  by  ARTS  resource  POC  on  a  case  by  case  basis  as 
requirements  are  identified. 

Training  Materials  &  Special  Supplies  Consumed  -  None.  (If  any 
are  consumed,  quantities  should  be  idenk  ified.  If  cos'-  -anno1: 
be  determined  by  SWT,  guidance  will  be  provided  on  a  cas :  bv 
case  basis). 

Training  Unit  Time  -  4  platoon  hours. 

lExamole  For  aat  for  Resource  Ca*:a  Collection  Wo:  <  5!  ^et) 


T  A B  F 


u a r  Tine  Pec  lod  Associated  Wi tn  TA  3emg  Add  re sued  - 
entry  is  nit  applicaDle  tor  separate  training  events; 
er,  if  events  are  aggregated  over  time,  that  tire  periO' 
d  te  shown,  e.g.,  1  yr,  1  qtr,  etc.). 

c  jrs  of  direct  Effort  Required  to  Support  tms  Training 
rs  (This  entry  includes  a  prorated  share  of  the  tire  of 
responsible  within  the  battalion  for  training  an  ageme 

Identification  -  1st  Platoon,  A  Co,  1/5  u  «.  .sc  r . 

1:  If  additional  resources  were  required  to  support  tn 

fire  exercise  (e.g.,  range  guards,  ammo  handlers, 
oilers,  safety  personnel,  etc.  the  associated  -an  hours 
'c-r.t  usage  need  to  be  recorded  using  the  sar.e  format  as 
r  a  i  n  e  e  s  . 

2:  Calculation  of  dollar  values  associate,  with  this 

mg  are  shown  at  Incl  1  to  this  TAB. 


Calculations  of  Dollar  Values  Associated 
Witn  Live  Fire  Exercises  of  1st  Platoon,  A  Co.,  1*5  3  Ar  m 


1 .  Program  2  -  Mission  (Equipment  Usage) 

Vehicles  Quantity  Avg  Mi  Tot  Mi  $  X i * 

M6  0  TK  5  3  0  '150 


Weapons 
M6  0  TK 
MG,  HB 
Fixed 
MG,  LT 
Fixed 


Quantity 

Cal  Ammo 

Avq  Rd/Wpn 

Tot  Rd  $/Rd* 

5 

10  5mm 

7 

35 

5 

. 5  0Ca 1 

100 

500 

5 

7 . 6  2mm 

400 

2,000 

Other  Equipment  -  None. 

NOTE:  See  TAB  G  for  a  listing  of  "Otuer 

Equipment"  and  TAB  K  for  appropriate 
cost  factors. 


2.  Ammunition 


Cal  of  Ammo 
1 0  5mm 
. 50Ca 1 
7  . 6  2mm 


Total  ♦  of  Rd  $/Rd* 

35 
500 
2,000 


3 .  Pay  &  Allowances 

Trainees  &  Trainers 


Grade 

No  Assiqned 

Man  Hours 

$/MH* 

E-3 

8 

32 

4 .4329 

E-4 

4 

16 

4.8474 

E-5 

4 

16 

5.7754 

E-6 

3 

12 

6.8523 

0-1 

1 

8 

6.6185 

15 

84 

Battalion  Training  Management  Personnel 

Man  Hours  $/MH** 

0,02 

Other  Personnel  -  None  [If  other  personnel  were 

required  to  support  this  training 
(See  NOTE  1  of  TAB  F)  their  pay 
and  allowances  would  be  calculated 
as  shown  above  for  trainees  and 
trainers]  . 


Total _ $ 

Total  $ 


$  OMA 

Total  $ 

$  PA 

Total  $ 


S  MPA 

Total  S 
S  MPA 


Inci  1  to  TAB  F 


Total  Fa/  3rd  Allowances  - 
TOY,  Transportation 

N 3 T I :  Cost  .njst  be  developed  locally  based  upon 
specific  requirements  for  the  training 
event.  Tnis  example  did  not  have  any 
r equ  i  r e.ment s . 


5.  Program,  2  Base  Ops  (Variable) 

Total  Man  Hours  X  $/MH 

84.02 

NOTE :  Total  man  hours  is  the  sum  of  all  the 

man  hours  associated  with  the  pay  and 
allowances  calculations  in  para  3  above. 
The  $/MH  is  a  MACQM  wide  cost  factor. 

A  listing  of  these  factors  is  at  TAB  M. 

6 .  Training  Aids/Devices 

NOTE:  None  for  this  example;  however,  ARTS 

Resource  POC  will  provide  costs  to  SWT 
on  a  case  by  case  basis  as  requirements 
are  identified  by  SWT,  costs  of  locally 
developed  aids/devices  must  be  determined 
locally . 

7 .  Training  Materials  &  Special  Supplies  Consumed 

NOTE:  The  NOTE  for  para  6  applies. 

8 .  Program  2  Mission  (Fixed) 

Total  Man  Hours  X  $/MH 

84.32 

9 .  Program  2  Base  Ops  (Fixed) 

Total  Man  Hours  X  $/'MH 

84 


*  The  values  for  these  cost  factors  are  taken  from 
of  cost  factors  found  at  TAB  G&L. 


$  OMA 

Total  $ 

$  OMA 

8  OMA  $  FA 


$  OMA  $  PA 


Total  $ 
$  OMA 


Totpal  _  S 
r  OMA 


a  listing 


2 


CONTENTS  OF  TAB  G 
LISTINGS  OF  VEHICLE,  WEAPONS, 
OTHER  EQUIPMENT,  AND  AMMO  FOR: 


Armor  Bn  -  TAB  G1 

Mech  Inf  Bn  -  TAB  G2 

Fid  Arty  (155  SP)  Bn  -  TAB  G3 
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COMPOSITE  STANDARD  RATES  FOR  COSTING  MILITARY  PERSONNEL  SERVICES 


PAY  GRADE 

ANNUAL  RATE 

HOURLY  RATE 

E-l 

$  6,561 

$  3.5503 

E-2 

7,557 

4.0892 

E-3 

8,192 

4.4329 

E-4 

8,958 

4.8474 

E-5 

10,673 

5.7754 

E-6 

12,663 

6.8523 

E-7 

15,192 

8.2208 

E-8 

17,777 

9.6196 

E-9 

21,415 

11.5882 

W-l 

14,528 

7.8615 

W-2 

16,638 

9.0032 

W-3 

20,039 

10.8436 

W-4 

25,075 

13.5687 

0-1 

12,231 

6.6185 

0-2 

16,677 

9.0243 

0-3 

21,395 

11.5774 

0-4 

25,988 

14.0628 

0-5 

31,521 

17.0568 

0-6 

38,674 

20.9275 

♦Hourly  rate  based  on  1848  hour  military  man  year 
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.  CONCEPT:  Training  analysis  during  testing  is  to  be  designed  to  measure 
skill  acquisition  and  learning  decay  over  time  by  use  of  diagnostics  and  re¬ 
training  time.  Development  of  diagnostic  testing  is  critical  to  success  as 
retraining  requirements  must  be  based  on  the  Delta  between  proficiency  attained 
at  completion  of  training  and  subsequent  residual  proficiency.  In  other  words, 


CORE  TEST  OBJECTIVES 
EEA 


A.  Continue  validation  of  threat  oriented  cr itical  SM/AFTEP 

tasks,  conditions,  standards. 

1.  Are  SM  tasks/ARTEP  events  based  on  the  documented 
results  of  appropriate  front-end  analysis  techniques? 

2.  Are  ARTEP  events  supported  with  prerequisite  SM  tasks? 

3.  Was  performance  of  SM/ARTEP  tasks  actually  necessary  for 
the  accomplishment  of  a  specific  mission?  (i.e.,  was  it 
truly  a  critical  task?). 

4.  Is  the  specific  level  of  proficiency  greater  than,  equal 
to,  or  less  than  that  required  to  meet  the  threat? 

B.  Determine  time/costs  to  achieve  optimal  proficiency  for 

critical  individual/collective  tasks. 

1.  What  resources  are  required  in  the  institution? 


a . 

Dollars 

e . 

Dollars  and  time 

b. 

People 

f . 

People  and  time 

c. 

Time 

g. 

Collars,  people  and  time 

d. 

Dollars  and  people 

2.  What  are  resources  required  in  the  unit? 


a . 

Dollars 

e . 

Dollars  and  time 

b. 

People 

f . 

People  and  time 

c . 

Time 

g- 

Dollars,  people  and  time 

d. 

Dollars  and  people 

3.  Does  the  collected  data  reflect  deviation  from  real- 
world  normalcy,  i.e.,  validity  of  trainee/instructor, 
NCO/officer  fill,  unusual  environmental  constraints 
or  advantages? 

C.  Continue  to  develop  diagnostic  tests  to  measure  individual/ 
collective  learning  decay  levels. 

1.  Do  current  diagnostic  tests  account  for  learning/decay 
which  occurs  subsequent  to  course/period  of  instruction? 


3 


2.  Does  the  diagnostic  test  program  provide  for  testing  at 
two  or  more  data  points?  (i.e.,  30,  60  &  180  days  afte 
training) . 

3.  Do  diagnostic  tests  provide  data  to  determine  specific 
skill/proficiency  loss  and  retraining  to  proficiency 
required?  (i.e.,  make  the  corrective  action  obvious). 

4.  What  is  the  training  resource  requirement  to  reacquire 
mastery  after  various  intervals  subsequent  to  the  orig¬ 
inal  training  program?  (Note:  All  training  activity, 
or  lack  thereof,  must  be  considered.) 

D.  Determine  decay  rates  and  frequency  of  retraining  required 

to  sustain  optimal  proficiency  for  individual/collective 

critical  tasks  (time/costs). 

1.  What  is  the  time  to  initially  learn  a  skill  to  mastery? 

2.  After  specified  intervals  without  practice  what  is  the 
time  required  to  relearn  a  skill  to  mastery? 

3.  Within  task  performance,  which  elements  are  forgotten 
first? 

4.  What  is  the  frequency  of  retraining  or  practice 
necessary  to  ensure  retention  of  acceptable  levels  of 
proficiency? 


1.  Reduce  Length  of  Selected  Courses  for  High 
Density/Low  Technology  M06's  vs.  Low 
Density/High  Technology  MOS's 


2.  Resources/Effect  of  Training  Common  vs. 
Technical  Skills  Chly  in  Institutions 


Not  used  in  TEA  78 


3.  Optimal  Allocation  of  Training  Tasks 
Between  Institution/Unit 

*  CHALLENGE:  Resources  required  to  train  to 

proficiency  in  collective/individual  tasks  vary  as  a 
function  of  the  type  task.  Acceptable  levels  of  decay 
in  proficiency  vary  with  the  missions  assigned  to  the 
unit.  It  is  necessary  to  identify  required  resources, 
rates  of  decay  for  critical  tasks,  and  retraining 
frequencies.  Such  determination  will  form  the  basis 
for  allocation  of  training  resources. 

*  CONCEPT:  EBta  should  be  extracted,  as  available, 
fraia  tests  as  to  time  and  training  methods  to  train  to 
individual  proficiency.  Post  training  diagnostic  tests 
administered  to  determine  proficiency  decay  over  time 
of  critical  skills  can  be  one  indicator  of  training 
best  conducted  in  the  unit  or  institution.  Skills  with 
lengthy  retention,  best  taught  with  sophisticated 
training  aids  are  best  taught  in  the  training  base. 
Gonversely,  skills  of  short  retention  with  hands-on 
practice  required  to  maintain  proficiency  are  best 
taught  in  the  unit.  This  determination  will  be  a 
function  of  the  degree  of  simulator/instructor 
intensive  support  required  and  the  rate  of  past 
training  decay.  (See  TRADOC  Pamphlet  350-30) 


Validate  Selected  Critical  Tcisks  For 
Service  School  Development  of  Hdw  to  Train 
to  Oombat  Proficiency  at  Least  Oost  in  a 


5.  Impact  of  Transfer  of  Selected  AIT  to 
FOPSCOM 

’  CHALLENGE:  Tb  determine  a  cost  efficient  policy  for 
training  entry  level  soldiers  to  proficiency  in  common 
and  MQS  related  skills.  The  feasibility  of  providing 
only  basic  training  for  selected  skills  in  the  training 
base  needs  to  be  tested. 

*  CONCEPT:  The  test  would  be  conducted  by  providing 
to  units,  replacement  personnel  in  selected  MOS,  who 
have  completed  only  common  skills  basic  training.  The 
unit  would  be  required  to  train  all  such  personnel  to 
proficiency  in  MOS  related  skills  without  increase  in 
current  ADO.  TRADOC  schools  will  provide  the  training 
packages  and  MTT's  to  ensure  supervisor  competence  as 
required.  Training  within  the  unit  should  be  conducted 
on  a  schedule  as  desired  by  the  commander,  excepting 
that  proficiency  required  be  as  established  by  the 
proponent  school.  Evaluation  of  comparative  costs  and 
the  effects  of  this  additional  training  load  on  unit 
readiness  will  be  determined  by  comparison  to  OSUT 
costs/proficiency  with  a  baseline  unit  and  by  test 
agency  evaluation  of  resultant  individual  and  unit 
proficiency. 


Impact  of  Transfer  of  BT  to  FORSCOM 

Impact  of  Transferr  ing  all  Entry  Level 
Training  to  FORSCOM 

Inpact  of  Transfer  of  all  Except  Critical 
Task  Training  to  FORSCOM 

Inpact  of  Transfer  of  all  Except  High- 
Technology  Thsk  Training  to  FORSCOM 

Effect  of  Expanded  BT  to  Develop  Qross 
Training  in  Support  MOS 


11.  Effect  of  Expanded  OSUT  for  Selected  High- 
pti  Weapons 

’  CHALLENGE:  Tb  determine  a  cost  efficient  policy  for 

training  selected  entry  level  soldiers  in  conmon  and  high 
priority  weapon  system  skills.  The  effect  on  unit  training 
and  costs  of  providing  training  to  maximum  proficiency  on 
critical  tasks  in  the  training  base  needs  to  be  tested. 

•  CONCEPT:  The  test  would  be  executed  over  an  extended 

period  by  conducting  entry  level  training  to  varying  levels 
of  proficiency  by  expanding  selected  OSUT.  Ttesting  will 
involve  control  and  test  groups.  Post  graduation  testing 
to  determine  learning  decay/retraining  rates  between  test 
and  control  group  will  provide  data  needed  to  design 
training  programs.  These  programs  provide  a  basis  for 
timely  resource  distribution  to  ensure  enhanced  individual 
skill  proficiency  and  retention  for  high  priority  weapons 
systems . 


10 


12.  Determine  Exportable/Job  TVaining  Packages 
Required  to  Support  Uraining  in  Units 


•  CHALLENGE:  Tb  rapidly  train,  sustain  or  retrain 

soldiers/units  in  skills  when  the  situation  does  not  permit 
conventional  training  or  when  the  skill  can  be  more 
adequately  taught  by  use  of  training  packages. 

•  CONCEPT:  The  concept  is  to  prioritize  skills  which  are 
critical  and  then  teach  these  skills  in  an  intensively 
structured  series  of  indiv/collective  training  periods. 
Maximum  use  of  training  will  be  made.  Tfesting  will  center 
on  comparative  analysis  of  costs  and  proficiency  attained 
over  time  against  a  baseline  of  similar  proficiency  levels 
attained  through  conventional  training.  Consider  the 
following  in  sequence: 

a.  Job  performance  aids 

b.  Self -teaching,  exportable  packages 

c.  Fbrmal/super vised  OJT  programs 

d.  Installation  (shadow)  or  unit  school 


li.  Determine  Training  Packages  to  Assure 
Supervisor  Competence 

4.  Determine  MOS  Transition  Training  on 
Proficiency  on  New  Equipment/Job 

5.  Determine  Resources  Ftequired  to  Attain  Unit 
Collective  Proficiency  (Tft) 


Not  used  in  TEA  78 


16.  Effects  of  Personnel  S*  ah;l  it  v  ■  Tui  bulence 


on  Individual  "Col lect ive  Proficiency 


CHALLEJIGE:  Lack  of  personnel  stability  results  in 

lengthened  training/retraining  time  to  achieve  collective 
proficiency  in  critical  task  skills  as  well  as  accelerated 
decay  of  collective  proficiency. 

CONCEPT:  Testing  the  effects  of  turbulence  and  stability 
envisions  introducing  controlled  turbulence  or  quantifying 
existing  turbulence  in  the  training  environment  (within 
crews  and  within  companies)  and  then  measuring  the 
proficiency  decrease  in  contrast  to  the  proficiency  of  more 
stabilized  crews/units.  This  should  permit  determination  of 
the  increased  resources  and  time  necessary  to  attain  and 
maintain  individual/collective  proficiency  when  there  is 
high  personnel  instability  by  determining  the  level  of  over¬ 
training  required  to  maintain  a  desired  level  of 
proficiency.  Consider  also: 

a.  Effects  on  unit  training  programs  (continuity) 

b.  Effects  on  development  of  leadership 

c.  Attitudes  on  training  such  that  retraining  frequency  is 
changed. 
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Fill  on  Collective/Individual  Training 


CHALLENGE:  A  low  percentage  of  officer./NCC  fill 

interacts  with  other  unit  training  distractors  (turbulence, 
troop  diversions,  auth  absences,  etc.)  to  degrade  training 
effectiveness  and  proficiency. 

*  CONCEPT:  Ttesting  the  training  effects  of  officer/NCO 

fill  variables  requires  evaluation  of  fill  variation  in 
conjunction  with  testing.  Data  will  be  extracted  to  enable 
determination  of  the  resources  necessary  at  different  levels 
of  officer/NCO  fill  to  attain  individual/collective  critical 
task  proficiency  and  to  establish  the  type  and  frequency  of 
retraining  necessary  to  maintain  that  proficiency. 


T)D-R186  322  ARMV  TRAINING  STUDV  TRAINING  EFFECTIVENESS  ANALVSIS 
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UNCLASSIFIED  S8I-AD-F000  108 
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18.  Effects  of  Introducing  Less  Capable 
Personnel  into  the  Training  Base  and  Units 


* 

I 

*  CHALLENGE:  The  AWC  SSI  study  on  Army  85  predicts  the 
typical  incoming  soldier  of  1985  will  be  less  capable  of 
mastering  complex  training  than  his  comparable  peer  today. 

•  CONCEPT:  Ttesting  the  effects  of  less  capable  trainees 
envisions  special  attention  under  controlled  conditions,  to 
determine  the  problems  which  result.  Testers  should 
identify  less  capable  personnel  participating  in  test 
activities  and  seek  to  determine  the  additional  resources 
needed  to  bring  these  soldiers  to  average  proficiency.  The 
effects  that  application  of  these  additional  resources  have 
on  other  trainees  and  unit  training  programs  should  also  be 
quantified.  A  range  of  solutions  applicable  to  a  specific 
set  of  tasks,  conditions  and  standards  should  be  obtained. 
Data  will  be  extracted  to  assist  in  determination  of 
personnel  selection  criteria. 
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19.  Evaluation  of  fepid  Re  freshet'  Training 
Programs  for  Reserve  Component  Units 


*  CHALLENGE:  Reserve  Component  units  must  be  rapidly 

trained  up  with  refresher  training  to  peak  critical  task 
skills  prior  to  deployment.  (Pre  and  post  M-day) 

*  CONCEPT:  Train-up  packages  for  critical  systems  and 

units  must  be  designed,  fielded  and  validated  for  Reserve 

Conponent  units.  Packages  must  be  designed  such  that 

training  can  be  accomplished  by  RC  trainers.  They  must 

produce  units  trained  to  combat  proficiency  in  the  shortest 

time,  both  pre  and  post  mobilization.  After  the  packages 

have  been  validated  at  company  level,  battalion  level 

packages  will  be  developed.  In  addition,  further  packages 

must  be  devised  to  rapidly  train  up  troops  who,  after 

deployment,  are  issued  new  and  different  equipment. 

Training  packages  (modular  training)  will  be  administered  to 

RC  units.  Post  training  proficiency  will  be  measured 

against  baseline  units  trained  under  existing  RC  programs. 

Costs  to  proficiency  and  levels  of  proficiency  will  be 

compared  to  validate  training  modules  and  to  provide 
* 

necessary  feedback  to  modify  modules  as  necessary. 
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20.  Develop  Training  Concepts  to 
Individual/Collective  Proficiency  with 
Reduced  Resources 


•  CHALLENGE:  Training  systems  must  be  devised  to  enable 
the  institution  and  units  to  train  to  proficiency  within 
decremented  resources. 

*  CONCEPT:  Training  programs  for  testing  will  be  analyzed 
to  identify  use  of  advanced  or  innovative  training 
techniques  which  result  in  a  degree  of  proficiency  at 
reduced  resources.  The  effectiveness  of  these  innovative 
programs  should  be  validated  during  testing  and  reports 
prepared  which  document  fully  the  resources,  training  events 
and  level  of  proficiency  attained.  Where  possible,  decay 
rates  for  proficiency  thus  obtained  should  be  determined  and 
compared  to  conventional  training  decay. 


21.  Develop  Fteplacement  (D+30  to  D+180)  Unit 
Upgrade  Training  Programs 

22.  Determine  Training  Required  to  Exploit  the 
Enhanced  Capability  Designed  into 
Modernized  Equipment 

23.  Determine  Optimal  Use  of  Equipment  Pools  to 

Support  AC/RC  Uhit  Training-  - 

24.  Develop  Training  Programs  to  Assimilate  New 
Equipment  in  Units 


Not  used  in  TEA  78 


25.  Validate  Effectiveness  and  Efficiency  of 
Braining  Devices 

•  CHALLENGE:  Braining  devices  are  developed  in  concert 
with  the  major  system  they  are  designed  to  support.  Care 
must  be  taken  to  ensure  that  skills  developed  on  training 
devices  are  reliably  transferable  to  the  actual  system. 
Further,  these  skills  must  be  those  necessary  for 
development  of  proficiency. 

*  CONCEPT:  Testing  will  be  designed  to  compare 

individual/collective  performance  of  actual  tasks  after 
training  on  training  devices.  A  comparison  to  training 
conducted  exclusively  on  the  real  equipment  and  in  mixes  of 
devices  and  real  equipment  will  be  made.  Gosts  to 
proficiency  will  be  compared  and  use  of  training  devices  to 
reinforce  and  retrain  decayed  skill  will  also  be  measured. 


26.  Develop  Staining  Programs  to  Conduct 


DEPARTMENT  OF  THE  ARMY 

HEADQUARTERS  US  ARMY  TRAINING  STUDY 
SORT  REIVOIR,  VIROINIA  23060 


ATCG-ATS  2  4  ,‘.378 


MEMORANDUM  FOR  RECORD 


SUBJECT:  TEA  78  Tests 


1.  Purpose:  To  record  agreements  concerning  the  TEA  78  Tests 
between  the  SWT  and  ARTS  Gp  and  to  provide  for  responsibilities 
for  add  ons  or  additional  testing. 

2.  Agreed  Actions: 

a.  M60A1/XM1  Tests 

(1)  The  ARTS  Guidelines  for  SWT  Reports  were  accepted  for 
implementation  subject  to  any  clarification  which  may  prove 
necessary  after  further  study. 

(2)  The  following  tests  were  reviewed  and  changed  as  indi¬ 
cated: 

(a)  Tank  Crew  Turbulence  Research 

_1  Baseline  correlation  will  include  the  five  Armor  Bns  of 
the  1st  AD. 

2  Final  reports  will  include: 

a  Tank  crew  turbulence  test  results,  10  Jun  78. 

b  Demographic  data  on  firing  crews  (AIR)  TBD. 

c  Results  of  train-up  HE  (CDEC)  ,  1  Jul  78. 

d  HumRRO  Costs  to  proficiency  1  Jul  78. 

3  Interface  w/TEA  85  core  objectives/variables  has  been 
accepted  by  ARI. 

(b)  Proficiency  &  Retention 


ATCG-ATS 

SUBJECT:  TEA  78  Tests 

_1  Objective  3  is  not  being  met.  Units  are  not  complying 
with  requirements  to  record  training  from  date  of  assignment. 

2  Sample  sizes  are  reduced  from  300  to  from  200  to  300. 

3  Interim  report  date  was  deferred  from  early  April  to  mid- 
April.  Final  report  date  was  postponed  to  mid-June  78. 

_4  Variable  18  was  added  to  Tj  &  Tg. 

2  Core  objectives  A  &  B  were  deleted  from  Tft  as  unobtain¬ 
able  due  to  test  design  &  unit  noncompl iance . 

(c)  Modular  Training  for  RC. 


3  Bns . 


2  Sample  size  was  reduced  from  108  TK  crews  to  90  crews  in 


Table  VIIC  Scores  were  added  to  data. 


2  All  retention/decay  deliverables  were  deleted  as  unobtain 
able  due  to  test  design. 

(d)  M60A1  WSTEA :  The  data  from  M60A1  WSTEA  will  be  inputted 
to  TXM  to  determine  if  a  delta  in  force  exchange  does  exist  in  a 
pure  tank  on  tank  situation.  If  a  delta  does  exist,  the  data  will 
be  run  in  the  CARMONETTE  combined  arms  model  to  determine  combined 
arms  combat  effectiveness. 

(e)  M60A1  Scaled  Range  Subcaliber  test: 

2  The  Test  was  expanded  to  two  phases:  Phase  1  tests  40 
crewmen  of  the  194th  Armored  Bde  by  firing  a  modified  table  IV 
and  table  VI;  Phase  II  includes  the  original  firing  program, 
except  that  the  the  sample  has  been  reduced  from  480  to  400. 

2  Phase  1  interim  report  data  has  been  established  as  30 
Aug  78  with  the  final  report  completion  estimated  as  9  Nov  78. 
Report  dates  are  contingent  on  start  date  of  15  May.  This  start 
date  may  conflict  with  AOB/BAT/BNCOC  training. 

(f)  Training  Time  Ratio:  No  changes  were  made.  COL  R. 

Maxham  provided  initial  test  concept  papers  which  will  be  re¬ 
viewed  by  ARTS  and  coordinated  with  the  ARTS  Battalion  Training 
Survey  and  General  Survey. 
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ATCG-ATS 

SUBJECT:  TEA  78  Tests 

(g)  XMl  OTII:  No  change  was  made  in  the  test  objectives 
nor  in  the  situational  variables.  It  is  clear,  however,  that 
ARI  support  to  develop  and  field  a  test  to  determine  core 
objectives/situational  variables  is  necessary.  Appropriate 
HRN  has  been  submitted  to  ARI  by  ARTS  through  TRADOC  DCS-T. 

b.  REDEYE  Engagement  Test: 

(1)  The  ARTS  reporting  format  was  not  accepted,  by  USAADS 
because  much  effort  has  already  been  expended  in  comparative 
data  in  the  USAADS  format.  However,  the  modular  data  assembly 
concept  will  be  complied  with. 

(2)  It  was  agreed  that  an  interim  report  would  be  fur¬ 
nished  on  1  Jul  78.  That  report  will  be  essentially  a  draft  of 
the  final  report  and  will  contain  data  available  at  the  time 
that  the  report  is  prepared. 

(3)  The  work  sheets  and  summary  sheets  were  updated  and 
modified  as  follows: 

a  Update  of  the  participating  units  to  include  5ID,  7ID 
and  24  ID.  The  field  testing  schedule  was  also  updated. 

b.  Variable  19  was  modified  to  reflect  that  if  would  pro¬ 
vide  only  insights  into  post-mobilization  training. 

c.  TOW  Tests: 

(1)  Delete  Variable  11  from  TOW/ITV  Training  Weaknesses  as 
without  an  OSUT,  the  impact  of  an  "expanded  OSUT"  is  con¬ 
sidered  confusing.  Same  information  will  be  apparent  but  in  conte 
of  "initial  OSUT". 

(3)  Interface  of  TRASANA  war  model  to  core  objectives/ 
variables  should  be  addressed  with  TRASANA. 

(4)  Delete  Variable  3  from  TLAT  test  as  USAIS  conducts  no 
institutional  training  for  RC  units  per  se.  RC  units  can 
attend  AC  institutional  training.  The  problem  is  in  the 
semantics  and  the  same  information  will  be  produced  and 

r epor  ted . 

(5)  Variable  18  is  defined  as  selection  from  any  group, 
not  CAT  IV  per  se . 


(6)  Add  Variable  25  to  ITV  test. 


ATCG-ATC 

SUBJECT:  TEA  78  Tests 


d.  FO/Unit  Training  Tests: 

(1)  An  interim  report  on  test  progress  will  be  provided  to 
ARTS  as  of  1  July  1978.  This  report  will  provide  current 
status  of  the  test  and  any  data  that  is  of  significance  and 
available  on  that  date.  It  is  recognized  that  available  data 
will  be  limited  because  of  the  close  proximity  of  the  report  to 
the  data  collection  period.  (15  May  to  15  June) 

(2)  Three  surveys/questionnaires/tests  are  involved  in 
this  test. 

(a)  FO  Unit  Training  Management  Survey  --  This  is  to  be 
administered  as  a  structured  interview  at  the  unit.  The  re¬ 
quired  data  collection  from  unit  training  records  to  be  used 
for  this  interview  will  be  forwarded  to  the  unit  in  advance  and 
the  12  months  to  be  looked  at  will  be  specified. 

(b)  FO  SQT  format  written  exam  on  "Call  for,  and  adjust¬ 
ment  of  fire  techniques."  This  exam  is  to  be  administered  to 
individual  FO's. 

(c)  FO  Questionnaire.  This  will  develop  opinions  of  the 
adequacy  of  the  unit  training  programs  as  well  as  the  demo¬ 
graphic  data  on  the  test  population. 

(3)  Changes  to  ARTS  Summary  Sheets.  Variable  17  was 
removed  from  Ts  because  it  is  not  really  measured  by  the  test 
procedures.  Core  B  was  reworded  to  reflect,  "as  reflected  by 
unit  training  schedule  information." 

e.  OFT  CTEA  w/expansion  TEA  78  and  13  F  Export  Analysis. 

(1)  An  interim  report  will  be  forwarded  to  ARTS  as  of 

1  July  1978  providing  current  status  and  any  data  available  on 
that  date.  It  is  recognized  that,  because  of  the  late  arrival 
of  the  OFT  device  at  Fort  Sill  (30  Apr-15  May  current  projected 
time) ,  and  the  late  availability  of  classes  for  testing,  only 
limited  data  will  be  available  on  1  July  1978. 

(2)  Six  separate  surveys/questionnaires  or  tests  are  being 
used  as  part  of  this  test. 

(a)  Institutional/unit  background  questionnaires.  These 
will  gather  demographic  and  background  data  on  test  population. 
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ATCG-ATS 

SUBJECT:  TEA  73  Tests 

(b)  STEP  Test.  This  standard  math  test  permits  random 
class  groupings  with  respect  to  math  aptitude. 

(c)  Observed  Fire  Exam.  This  exam  was  specifically  de¬ 
veloped  to  test  level  of  knowledge  of  observed  fire  proced¬ 
ures  prior  to  initiation  of  training  as  part  of  this  test. 

This  information  will  be  used  along  with  math  scores  to  insure 
random  placement. 

(d)  Institutional/Unit  opinion  questionnaire.  This  ques¬ 
tionnaire  develops  the  test  population  opinion  of  the  training 
devices  used  as  a  part  of  the  test. 

(e)  The  final  course  exam  on  observed  fire  along  with  the 
live  fire  mission  grades  will  be  accepted  as  the  proficiency 
level  at  the  end  of  the  training  test  being  conducted. 

(f)  Instructor  Questionnaire.  This  will  develop  the  opin¬ 
ions  of  the  instructors  as  to  the  effectiveness  of  tne  training 
devices  being  tested. 

(3)  There  are  several  changes  to  the  sample  sizes. 

Changes  to  school  class  sizes  from  120  to  200  for  the  officer 
class  and  from  20  to  20-50  for  13F  classes,  are  based  upon 
updated  projections  of  class  sizes.  Changes  to  unit  sample 
size  reflect  the  addition  of  the  approved  support  of  63 
personnel  for  the  basic  OFT  CTEA.  Fort  Sill  is  requesting  63 
additional  personnel  from  FORSCOM  for  the  CTEA  expansion.  They 
would  accept  33  additions  if  assured  of  the  30  from  the  ARTS 
effort.  The  desired  sample  size  for  the  test  is  125. 

(4)  Core  C  was  modified  to  reflect  a  measure  of  profi¬ 
ciency  only  because  the  beginning  and  ending  tests  are  not 
comparable  and  cannot  be  used  to  provide  a  delta  measurement  of 
proficiency.  Variable  19  was  modified  to  reflect  insights  into 
devices  which  might  be  used  for  RC  training.  It  does  not  test 
RC  personnel  as  such.  Variables  3  and  5  more  correctly  belong 
in  the  1 3F  Expor t- Ana lys i s  and  were  deleted  from  the  OFT  CTEA 
expansion.  They  are  listed  in  the  13F  export  analysis. 

(5)  Because  the  OFT  CTEA  includes  a  comparison  of  OFT,  BT- 
33  and  FOT  to  determine  the  most  efficient  and  effectual  device 
for  training,  an  exportable  package  cannot  be  developed  until 
tne  CTEA  is  completed  and  the  best  simulator  determined 

f.  63C/H  CSS  MOS  Test 
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(1)  The  63C/H  test  effort  is  proceeding  IAW  the  December 
1977  SWT  plan. 

(2)  SQT  administration  for  MOS  6 3C  and  H  has  been  slipped 
by  DA  to  the  May-July  78  time  frame.  Computer  processing  will 
add  a  minimum  of  6-8  weeks.  As  a  result,  comparison  of  SQT 
results  with  test  data  will  not  be  available  until  August  1978. 

(3)  The  identification  of  collective  proficiency  capa¬ 
bilities  will  become  part  of  follow-on  efforts  to  be  completed 
after  August  1978.  This  is  an  agreement  with  the  December  1977 
plan.  This  effort  should  be  incorporated  into  TEA  85. 

(4)  Official  USAOCCS  agreement  on  the  SWT/ARTS  Deliverable 
Summary  Sheets  is  limited  to  material  appearing  in  the  Test 
Activity  column.  While  advice  concerning  the  potential  inter¬ 
face  with  TEA  85  has  been  provided,  extension  of  the  USAOCCS 
into  TEA  85  will  require  specific  tasking  through  TRADOC 
channels  IAW  the  approved  Five-Year  Test  Plan. 

g.  05C/F  MOS  Test 

(1)  Subject  to  the  availability  of  historical  resource 
data,  and  unit  training  resource  methodology,  all  05C  tests 
will  encompass  Resources  to  Proficiency  in  the  ARTS  Model. 

(2)  Regarding  the  comparison  of  self-paced  and  group- 
paced  courses,  Variable  25  was  deleted  because  there  are  no 
training  devices  in  either  course. 

h.  CAMMS 

(1)  The  ARTS  Guidelines  to  SWT  Reports  were  accepted  for 
implementation  and  will  be  used  to  structure  CAMMS  test  reports 
to  ARTS. 

(2)  The  CAMMS  test  was  reviewed  and  the  following  changes 
were  made: 

(a)  Test  objective  1  was  deleted  and  the  following  objec¬ 
tive  inserted:  "Measure  effectiveness  of  CAMMS  as  a  training 
Method . " 

(b)  Test  object  4  was  caveated  to  tie  it  to  long  term 
evaluation^  tied  to  use  of  the  NTC . 


oudj  i  : 
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(c)  The  interim  report  date  was  deleted  as  testing 
will  not  be  completed  until  15  May.  The  final  report  date 
for  the  short  term  effort  was  confirmed  as  1  July  197S. 

(d)  All  interface  w/TEA  85  core  objectives  and  situational 
variables  were  accepted  subject  to  the  following  clarification: 

The  short  range  study  report  of  1  July  1978  will  cover  only 
resources  to  level  of  proficiency  attained.  Data  concerning 
programs  to  proficiency  (number  and  interval  between  itera¬ 
tions),  learning  decay  and  frequency  of  retraining  and  validity 
of  CAMMS  skill  transfer  to  actual  operation  can  only  be  obtained 
in  the  TEA  85  program.  In  the  interim,  CATRADA/CAMMS  will 
develop/explore  and  report  the  TEA  85  type  issues  to  the  level 
of  resolution  supportable  by  the  data. 

i.  Cannon  Crew  Turnover 

(1)  The  validation  of  this  test  was  conducted  on  17  March 
1978.  The  test  appeared  to  be  well  conducted  with  only  minor 
problems  which  involved  some  additional  training  for  scorers. 

Dr.  Goldberg  of  ARI ,  is  aware  of  this  and  will  take  corrective 
actions . 

(2)  The  TEA  78  team  will  request  a  draft  report  of  the  results 
of  this  validation  test  from  HQS  ARI. 

(3)  The  actual  test  is  scheduled  for  August  1978  at  Fort 
Lewis,  WA,  with  two  9ID  close  support  FA  Bns. 

j.  TACFIRE  POST  OT  III.  The  turbulence  tests  on  TACFIRE  OT 
III  crews  were  not  accomplished.  Some  limited  data  should  be 
available  by  1  July  1978  from  tests  on  new  crew  members  who  will 
graduate  from  Fort  Sill  on  17  April  1978.  Dr.  Sanders,  ARI  field 
office.  Fort  Hood,  TX,  indicated  ARTS  should  request  a  draft  copy 
of  both  the  ARI  Post  OT  III  report  and  the  follow  up  turbulence 
tests  from  ARI,  HQS.  TEA  78  team  has  requested  these  reports. 

3.  Unresolved  issues. 

a.  ARI  acceptance  of  the  TEA  85  objectives/situational 
variables  is  dependent  on  further  study. 

b.  Final  report  dates  for  the  demographic  portion  of  the 
tank  crew  turbulence  test  must  be  coordinated  w/AIR  and  Dr.  J. 
Shields,  ARI. 
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c.  Command  action  is  necessary  to  obtain  support  of 
FORSCOM/'USAREUR  commanders  for  the  documentation  of  time/re¬ 
sources/training  in  support  of  the  proficiency  and  retention 
tests . 

d.  ARTS  must  work  w/the  SWT  to  develop  operation  and 
scaling  for  the  training  time  ratio  test.  These  must  be 
coordinated  w/the  Battalion  Training  Survey  and  the  General 
Survey . 

e.  REDEYE  Test.  USAADS  requires  assistance  in  obtaining 
approval  to  visit  the  REDEYE  sections  of  the  Berlin  Brigade 
during  firing  in  Spain.  There  is  a  quota  limitation  on  the 
number  of  US  troops  in  Spain  which  will  be  at  its  upper  limit 
during  the  period  of  the  visit.  USAADS/TRASANA  will  keep  ARTS 
informed . 

f.  TOW  TEA  Ph  results  with  "minimum"  training  program 
suggests  TEA  may  stop  after  90  missiles.  Decision  hinges  on 
23-25  March  firings. 

g.  FO  Unit  Training  Test.  The  support  of  this  effort  by 
TRASANA  is  still  under  negotiation  between  USAFAS,  Fort  Sill  and 
TRASANA,  White  Sands. 

h.  CSS  MOS  63C/H  TEA. 

(1)  The  initial  planning  estimate  to  complete  the  63C/H 
effort  was  $23,000.  Of  this,  $5,000  was  funded  locally  and  a 
request  was  forwarded  to  TRADOC  for  $18,000.  TRADOC  increased 
the  travel  allocation  for  the  USAOCCS  by  $15,000.  Funds  in  this 
amount  were  diverted  to  the  ARTS  effort  from  other  USAOCCS 
funding  allocations.  TRACOC  indicated  that  the  additional 
$3,230  would  be  addressed  at  the  FY78  BER. 

(2)  Due  to  the  large  amount  of  data  to  be  gathered  from 
each  individual  tested,  it  was  determined  during  the  validation 
testing  that  an  additional  day  had  to  be  added  to  the  period  of 
time  spent  in  each  division  and  that  one  person  had  to  be  added 
to  the  testing.  Additional  on-site  test  preparation  time  has 
also  been  determined  to  be  necessary.  This  resulted  in  an  addi¬ 
tional  cost  of  $5,300  which  raised  the  total  ARTS  cost  to 
$28,300. 

(3)  While  the  USAOCCS  recently  experienced  a  TRADOC-wide  10 
percent  cyt  in  travel  funds,  the  portion  of  this  sum  which 
applies  to  ARTS  will  be  absorbed  by  the  school  by  deleting  other 
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high  priority  evaluation  efforts.  This  still  leaves  a  shortfall 
of  $8,300.  If  the  shortfall  of  $8,300  is  not  funded, _  testing 
planned  at  USAREUR,  Fort  Riley  and  Fort  Hood  {49th  Armed  Div) 
cannot  be  executed. 

(4)  DARTS  support  at  TRADOC  level  to  obtain  these 
additional  funds  is  requested.  In  the  event  these  funds  are  not 
provided,  DARTS  guidance  regarding  changes  to  the  test  plan  will 
be  requested. 

(5)  If  additional  funding  is  not  provided,  1st  ID  testing 
willbe  cancelled.  This  would  result  in  a  reduction  of  the 
data  base  by  25%. 

i.  05C/F  MOS  Test 

(1)  05C/F  OSUT  start  delayed  until  May.  SWT  estimates 
OSUT  graduate  data  collection  from  1  July-15  September.  Accord¬ 
ingly,  SWT  estimates  final  report  for  this  test  to  be  15  Sep  78. 

(2)  Due  to  travel  fund  constraints  05C  testing  in  the  9th 
ID  and  1st  AD  has  been  cancelled.  Testing  will  be 
conducted  in  the  24  ID  and  49  AD  ( ARNG) . 

j .  CAMMS  TESTING 

(1)  The  sample  size  has  been  once  again  reduced  from  the 
original  10  Bns  to  5.  Of  these,  3  are  from  4th  ID  and  2 
from  1st  ID.  This  is  caused  by  commitments  of  1st  ID  Bn. 

(2)  CATRADA  needs  guidance  from  TRADOC  as  to  implementa¬ 
tion  of  CAMMS/NTC  follow-on  tests  in  TEA  85  so  as  to  better  co¬ 
ordinate  &  execute  TEA  78  testing, 

k.  BATTLE 

(1)  TRASANA  has  no  plans  for  using  "BATTLE"  in  a  test  mode 
to  determine  what  is  taught  through  its  use.  It  was  agreed, 
however,  that  a  test  could  be  developed  using  the  following 
concept . 

a.  Issues 

1_  How  can  BATTLE  be  adapted  to  a  training  role? 

2  Stop  action/on-line  critiques. 
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3  Special  operations  -  River  Crossing,  smoke,  mine 
field  clearing.  Use  of  CAS,  FA? 

_4  Standardized  scoring  procedures  need  to  be  developed. 

5  Mission  specific  scenarios,  attack,  defend  and  delay 
need  be  developed. 

6  A  baseline  for  acceptable  performance  should  be 
establ ished . 

7  Can  we  determine  existing  skills  in  weapons  employment? 
(i.e.  in  use  of  tanks,  armor  use  of  infantry.) 

b.  Costs  to  play  Battle  per  Bn  Cmd  Group.  Time  is  5-7 
working  days  per  Bn  Cmd  Group,  with  terrain  board  &  computer. 

c.  Test  sample  size  -  8-10  Bns  tested  twice  each  with  a 
short  time  interval  (2  weeks?)  between  tests. 

d.  Methods  for  measuring  (quantifying)  training 
value  of  BATTLE. 

0.  Play  ARTEP  and  measure  performance.  (Cmd  Gp  module) 

1.  Questionnaire  aimed  at  the  basic  question  "what  was 
learned  during  play  of  BATTLE?"  (CATRADA  doing  this  in  conjunc 
tion  w/DRS) 

(<a)  Administered  post  play  period. 

(b)  Cluster  analysis  of  answer. 

la  In  parallel  with  step  1^  develop  by  analysis  a  list  of 
areas  in  which  learning  is  expected  to  occur  by  playing  BATTLE. 

lb  Take  union  of  step  _1  and  l_a  as  the  list  for  2. 

2  Develop  standard  test  that  can  be  used  pr e  and  post 
play  That  covers  the  list  produced  by  step  _lb. 

3  Use  data  from  BATTLE  to  check  those  clusters  from  step 
and  other  elements  from  step  2  for  which  the  data  is 
appl icable . 

4  Play  ARTEP  and  measure  performance. 
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5  Use  feedback  to  change  BATTLE  Al'TEP  or  Pre-Post '  test  . 

e.  Three  options  exist  to  execute  the  BATTLE  test  within 
context  of  TEA  78. 

OPTION  A 

TRASANA  design  test  (would  cause  delay  in  ongoing 
efforts  for  ARTS) . 

CATRADA  conduct  tests  w/Cmd  Groups 

(CATRADA  has  three  battle  sets) 

TRASANA  Analyze  Results. 

OPTION  B 

TRASANA  Continue  to  march  for  ARTS  as  per  DPCS  (under 
a  revision  to  this  DPCS  as  is  currently  being  proposed  by 
TRASANA) 

CATRADA  Execute  entire  program. 

OPTION  C 

Either  A  or  B  above  w/ARI  designing  test  &  assisting 
in  analvsis. 

(2)  TRASANA  position  on  use  of  war  models  to  CE. 

(a)  Analysts  do  not  know  which  tasks  should  be  incorporated 
in  CARMONETTE  and  other  models  do  not  appear  appropriate. 

(b)  Analysts  need  a  list  of  SM/ARTEP  tasks  and  varying 
levels  of  proficiency  to  put  in  the  model. 

(c)  TRASANA  management  feels  ARTS  requirements  should  be 
integrated  in  the  TRASANA  Model  Improvement  Program.  The  Bn 
model  improvement  group  works  under  TRASANA  agis-Div  Model  group 
is  under  CACDA.  This  suggestion  has  been  adopted  and  testing  of 
"Battle"  training  value  will  be  deferred  to  a  follow-on  period. 


3.  Act ions/Decisions . 
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a.  LTC  Shambayer  requested  ARTS  guidance  (since  ARTS  is 
funding  TEA  78  CAMMS)  as  to  actions  to  be  taken  if  one  or  more 
principal  staff  fail  to  report  for  CAMMS  testing  w/the  Bn  and 
Group.  LTC  Bloedorn  decided  that  judgement  must  be  used  in  all 
cases,  but  when  it  became  clear  that  unqualified  players  or  un¬ 
acceptable  absences  would  contaminate  the  data,  that  CATRADA 
should  cancel  and  save  the  money,  This  policy  should  be  announ¬ 
ced  during  coordination  sessions  to  assist  unit  commanders  in  as¬ 
signing  priorities. 

4.  Actions  Required: 

a.  Action  should  be  taken  by  ARTS/TRADOC  DCS-T  to  schedule 
three  additional  combined  Arms  Bns  for  CAMMS  testing  ASAP  to  ensure 
minimum  sampling  by  15  May. 

b.  Coordination  should  be  made  with  TRADOC  DCS-T  to  deter¬ 
mine  when  CATRADA  will  receive  necessary  guidance  to  ensure  con¬ 
tinuity  between  TEA  78  &  TEA  85. 

c.  FO  UNIT  1EA/OFT/13F  TEA  78. 

(1)  Validation  of  the  13F  Course  of  Instruction  must  be  ac¬ 
complished  prior  to  the  test  of  the  training  devices.  Because 
of  shortfalls  in  13F  course  fill,  the  COI's  earliest  validation 
will  occur  on  or  about  5  June.  USAFAS  must  complete  this  valid¬ 
ation  procedure. 

(2)  Each  of  the  OFT's  can  train  15  students  per  class. 

Plans  call  for  24  hours  of  instruction  per  class.  This  requires 
careful  scheduling  of  the  OFT's  since  only  two  are  expected  to 
be  available.  This  also  assumes  minimum  down  time  for  the  sys¬ 
tem.  USAFAS  must  manage  these  factors  and  keep  ARTS  informed  of 
si  ippage . 

(3)  Authorization  message  allowing  Fort  Sill  to  coordinate 
dates  and  arrangements  with  the  field  should  be  transmitted. 

e.  05C  TEA  78. 


(1)  A  formal  request  to  test  in  24ID  has  been  initiated 
by  ARTS. 

(2)  SWT  will  update/finalize  test  plan  and  forward  to  ARTS  ASAP. 
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f.  CSS  TEA  78. 

(1)  Obtain  additional  travel  funds  or  modify  SWT  *  t z ‘ 
plans.  DARTS  support  is  needed  at  TRADOC  level. 

(2)  Decision  to  modify  test  schedule  should  await  TRADOC 
funding  guidance. 

5.  Proposed  ARTS  Test  Site  Visits. 

a.  M60A1  Tests:  TBD 

b.  REDEYE 

(1)  24-28  Apr  78  -  8ID,  Flint  Hen,  GER 

(2)  24-28  Apr  78  -  101  ABD,  FT  Bragg,  (RELS,  LIVE  REDEYEj 

(3)  9  May  78-3  ACR,  Ft  Bliss,  (RELS) 

(4)  11-12  May  78  -  7ID,  Ft  Ord 

(5)  14-19  May  78  -  9ID,  Ft  Lewis,  (RELS) 

(6)  16-23  Jun  78  -  2AD,  1  CAC  Ft  Hood,  (RELS) 

c.  TOW  test  site  visits:  TBD 

d.  FO/OFT  Test  visit:  TBD 

e.  CSS/63C/H  Test  visit: 


(1) 

17- 

20 

Apr 

78  - 

8  ID*, 

USA  EUR 

(2) 

12- 

15 

Jun 

78  - 

4  9AD 

( ARNG)  Ft  Hood 

f  . 

05C 

Test 

visit; 

:  24  ID  TBD 

GARY  BLOEDORM 
LTC ,  AP. 

CH,  TEA  78  TM,  ARTS 
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Appendix  2  to  Annex  A 


Summary  of  TEA  ’78  Test  Program 

0 

The  test  result  summaries  are  presented  in  modular  form  in  t|^at  each 
test  has  its  own  page  or  pages  organized  in  the  following  manner: 

a.  Test  status 

b.  Responsible  agencies 

c.  Synopsis  of  test 

d.  Description  of  subtests. 

e.  Sample  size 

f.  Summary  of  Results,  Findings,  and  Conclusions 

Index  of  TEA  '78  Test  Summaries 


Armor  Tests  Pages 

a.  Tank  Crew  Turbulence  Test  A— 1—1 

b.  Proficiency  and  Retention  Test  A-2-1 

c.  Modular  Training  for  Reserve  Components,  Trans-  A-3-1 

ferred  to  TEA  '79 

d.  Modified  M60A1  WSTEA  A-4-1 

e.  Scaled  Range  Sub-Caliber  Tests,  Transferred  A-5-1 

to  TEA  '79 

f.  Training  Time  Ratio  Survey  A-6-1 

g.  XM 1  Operational  Test  II  Transferred  to  TEA  '79  A-7-1 

Redeye  Engagement.  Test  B— 1  —  1 

Ti  W  Tests 

TuW  Testing,  Transferred  to  TEA  '79  C— 1—1 
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Forward  Observer 

FO  Testing,  transferred  to  TEA  '79 

o3C/H 

a.  SQT  as  a  Nteasure  of  Proficiency 

b.  Proficiency  Development  Profiles 

c.  Cost  Effectiveness  of  Institutional  and  Unit 
Training  Programs 

d.  Optimum  Distribution  of  Individual  Training 
between  Institution  and  Unit 

e.  Determinations  for  Training  Selected  Personnel 

t  or  '-lobi  I  izat  ion 
jj  bC/F 

a.  Task  Performance  of  Self-Paced  and 
or oup-Pac ed  Graduates 

b.  Proficiency  of  05C/F  Teams  in  Field  Units 

c.  Alternative  Unit  Training  Programs,  Transferred 
to  TEA  '79  Program 

Add  on  T ests 

a.  .Anti-Armor  REALTRAIN 

b.  Rifle  Squad  REALTRAIN 

c.  CAMMS 


v 


D-l-I 

E— 1—1 
E-2-1 

E-3-1 

E-4-1 

E-5-1 


F—  1  —  1 


F-2-1 


F-3-1 


G— 1  —  1 


G-2-1 


G-3-1 
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Training  Instrumentation  Evaluation  (TIE),  Trans 
ferred  to  TEA  '79 

Cannon-Grew  Turnover,  Transferred  to  TEA  '79 
Tacfire  OT  III,  Transferred  to  TEA  '79 

Retention  and  Proficiency  of  Common  AIT  Skills, 
Transferred  to  TEA  '79 


TFTF 
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EFFECTS  OF  TANK  CREW  TURBULENCE 
ON  GUNNERY  PERFORMANCE 


a.  Test  status.  As  of  8  July,  the  test  has  been  completed  and 
results  circulated  in  draft  form.  No  further  data  reduction  or  analysis 
is  contemplated . 
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b.  Responsible  agencies.  The  test  plan  was  developed  by  the  US  Army 
Research  Institute  (ARI),  Fort  Knox  Field  Unit,  as  part  of  its  FY  1978 
work  program.  The  research  was  expanded  in  response  to  a  request  by 
director,  Army  Training  Study,  to  determine  the  effects  of  replacing  1  IE 
tank  crew  members  with  non-llE  crews  assigned  to  an  armor  organization 
other  than  the  baseline  battalion.  These  tests  were  conducted  by  the  Fort 
Knox  Field  Unit  of  ARI  and  HumRRO  and  were  sponsored  by  the  Commander,  US 
Army  Armor  Center,  Fort  Knox,  KY. 

c.  Synopsis  of  test.  The  test  was  conducted  in  three  phases. 

1.  Phase  I.  A  tank  crew  stability  questionnaire  was  constructed  to 

provide  22  measures  of  crew/crewnan  stability.  This  questionnaire  was 
administered  to  participating  tank  commanders  and  their  crewnan  separately 
to  gain  data  on  individual  turbulence  as  well  as  crew  turbulence.  C^aes- 
tioi'.naire  data  was  compared  to  tank  gunnery  performance  data  (i.e., 
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Table  VIII  opening  times  on  each  engagement  and  hit  or  miss  determination 
tor  main  gun  round  engagements).  Assessment  of  the  effects  of  turbulence 
on  crew  performance  was  determined  by  correlating  the  results  of  Table 
VIII  firing  data  with  three  variables:  changing  of  crewmen  between 
positions,  changing  soldiers  among  crews;  and  putting  crews  on  unfamiliar 
tanks . 

2.  Phase  II.  The  results  of  Phase  I  indicated  a  relation  between  a 
tank  commander's  position  familiarity  and  gunnery  performance  and  a 
relation  between  tank  commander/gunner  stability  and  gunnery  performance. 
Causal  relationships,  however,  were  not  clearly  shown.  The  purpose  of 
Phase  II  was  to  further  investigate  these  causal  relationships  by  artifi¬ 
cially  creating  levels  of  turbulence  to  facilitate  the  evaluation  of  the 
effects  on  gunnery  performance.  To  create  the  necessary  levels  and  types 
of  turbulence  the  experiment  used  four  structured  groups.  Group  one  was 
the  control  group.  The  other  three  groups  were  experimental  groups 
representing  the  different  states  of  turbulence.  Personnel  ir.  groups  one, 
two,  and  three  held  1  IF.  MOS  and  had  recently  completed  Table  VIII  firing. 
In  group  4,  nonarmor  crewman,  drawn  from  support  units  normally  available 
to  the  division,  were  assigned  as  gunners  and  loaders.  The  purpose  of 
including  Group  4  in  this  test  was  to  determine  the  validity  of  perfor¬ 
mance  based,  individually  paced,  tank  crewman  skills  training  (TCST) 
concepts  as  applied  to  accelerated  tank  crew  replacement  training.  These 
crewmen  received  three  days  of  intensive  training  specifically  designed  to 
prepare  them  to  fire  Table  VIII.  The  hypothesis  was  that  such  personnel, 
given  a  training  module  which  includes  maintenance  training  and  tactical 
training,  could  become  adequate  tank  crew  replacements  in  post- 
mobilization  emergencies.  (Maintenance  and  tactical  training  not  included 
in  three-day  program  tested.)  All  members  of  group  four  were  assigned  to 
unfamiliar  tanks  and  were  unfamiliar  to  each  other. 

3.  Phase  III  was  conducted  in  the  same  manner  as  Phase  II,  except 
that  a  separate  tank  company  was  divided  into  two  parts,  one  of  which  was 
given  a  one-day  train-up  and  the  other  a  three-day  program. 

d.  Description  of  subtests. 

1.  Phase  I  constituted  a  subtest  of  the  overall  research.  There  were 
two  objectives.  The  first  was  to  determine  the  degree  of  stability  in 
five  armor  battalions  in  USAREfR;  second  was  to  determine  the  relationship 
between  crew  stabilitv  and  tank  gunnery  performance  on  Table  VIII,  at 
Grafenwohr,  Germany. 
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2.  Phase  II  was  conducted  with  one  Armor  battalion  in  CONUS.  The 
primary  objective  was  to  determine  the  effects  of  crew  turbulence  on  tank 
crew  gunnery  performance  and  to  study  the  effects  of  replacing  crew 
members  with  nonarmor  personnel.  Concurrent  with  this  was  the  development 
and  evaluation  of  training  programs  for  nonarmor  replacements. 

3.  Phase  III  was  the  same  type  test  except  that  training  was  for 
nongunnery  qualified  tank  crewmen.  The  secondary  objective  was  to  test 
the  relationships  between  gunnery  performance  and  selected  turbulence 
variables  using  the  tank  crew  stability  questionnaire  (the  same 
questionnaire  used  in  Phase  I). 

e.  Sample  size. 

1.  Phase  I.  Sample  size  over  five  Armor  battalions  was  211  tank 
crews. 

2.  Phase  II.  Sample  size  for  one  Armor  battalion  was  52  tank  crews 
for  the  stability  questionnaire  and  four  groups  starting  with  11  crews 
each  for  the  firing  data  sample.  Only  40  crews  finished  the  test. 

3.  Phase  III.  One  additional  Armor  company  at  Fort  Hunter  Liggett, 

CA,  provided  16  additional  crews.  This  company  was  divided  into  two  test 
groups  of  eight  tanks  each.  One  group  received  a  one-day  intensive 
train-up  program  before  firing  and  the  other  received  three  days  of 
training.  The  study  was  conducted  in  two  replications  over  a  two-week 
period.  Four  crews  from  each  group  were  trained  and  tested  each  week. 

f.  Summary  of  results,  findings,  and  conclusions. 

1.  Summary  of  findings. 

(a)  The  following  significant  findings  were  reported  by  ARI: 

(1)  There  was  considerable  turbulence  in  the  battalions  evaluated. 

Complete  crews  had  normally  been  together  1-2  months,  while  typical  tank 
cr-omander/ gunner  pairs  had  been  together  2-3  months.  Typical  tank 
commanders  (TC)  ,  gunners  (Gnr)  ,  drivers  (Dvr),  and  loaders  (Ldr)  had  held 
their  positions  12-36,  6-12,  6-10,  and  3-6  months,  respectively. 

Variation  was  great  on  both  variables;  i.e.,  length  of  time  crewmen  had 
worked  together  and  hand  been  assigned  to  their  positions. 

(2)  Both  the  experience  of  the  TC  and  the  Gnr  in  their  positions  were  (QL1) 
positively  related  to  performance.  The  more  experienced  TCs  had  shorter 
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opening  times  and  experienced  gunners  had  more  hits. 


(3)  The  longer  the  TC  and  Gnr  had  trained  together,  the  shorter  were  (QL1) 
their  opening  times. 


Significant  Analytical  Relationships 


Opening 

Targets 

Time 

Hit 

Months  TC  as  TC 

X 

X 

Months  Gnr  trained 
as  Gnr 

X 

Months  TC/Gnr 
trained  together 

X 

(4)  Neither  the  time  the  whole  crew  had  been  together  nor  the 
experience  of  the  driver  or  loader  was  related  to  Table  VIII  experience. 
This  finding  requires  additional  research  as  the  Table  VIII  course  did  not 
test  dr iver/ loader  crew  interaction. 

(5)  Stabilization  and  training  of  tank  commanders  and  gunners  in 
their  respective  positions  should  be  emphasized  in  unit  training/manage- 
ment  decisions. 


Summary  of  Tank  Crew  Turbulence  Test  Results 


FINDINGS 


Significant  Army  Training  Study  Findings.  Analysis  of  the 
technical  report  data  base  reveals  the  following: 

(a)  The  average  crew  in  the  five  L'SAREUR  armor  battalions  sampled  had  (QL2) 
been  assigned  together  i-2  months  as  opposed  to  a  mean  of  5.0  months  over 

the  10  battalions  sampled  one  year  later  in  the  M60A1  WSTEA  (6  USAREUR 
battalions/ 4  CONUS  battalions).  This  indicates  that  either  turbulence  was 
worse  in  FY  1977  than  in  FY  1978  or  that  the  Armor  battalions  studied  in 
the  M60A1  WSTEA  had  different  personnel  management  programs.  A  similar 
relationship  exists  as  to  months  the  crews  trained  together.  The  M60A1 
WSTEA  mean  was  3.6  months  and  the  sample  median  under  discussion  was  0.8 
months  (Table  I,  F'nase  I,  Descriptive  Statistics,  Page  12).  (The  median 
figure  is  used  here  because  distribution  for  all  items  was  positively 
skewed  rather  than  normally  distributed,  leading  to  the  conclusion  that 
the  median  is  the  more  appropriate  indicator  of  central  tendency). 

( b)  Turbulence  -  gunner  relationships  are  consistent  with  data 

reported  in  the  TRASANA  M60A1  WSTEA  study  with  the  exception  that  a  (QL1) 

stronger  correlation  linking  probability  of  hit  (Ph)  to  tank  commander/ 
gunner  stability  and  experience  is  present.  The  confidence  level  of  this 
finding  is  at  alpha  <_.05. 

(c)  While  the  results  indicated  no  relation  between  the  gunner  per-  (QL3) 
formance  and  the  time  the  entire  crew  had  been  together,  indications  are 
present  that  the  longer  the  tank  commander  and  gunner  had  trained 

together,  the  more  rapidly  they  opened  fire  on  their  targets.  Since  crews 
were  not  required  to  fire  on  the  move,  the  failure  to  relate  driver/loader 
stability  to  gunnery  performance  may  be  more  the  result  of  an  Incomplete 
test  than  of  dr Lver/ loader  team  performance.  The  study  notes  "Because 
engagements  did  not  begin  until  the  tank  was  in  position,  the  driver's 
contribution  to  hits  and  opening  time  was  limited.”  The  M60A1  WSTEA  Study 
comments  support  this  contention  by  noting  the  inadequacy  of  Table  VIII  as 
a  valid  measure  of  effectiveness  due  to  the  lack  of  long-range  targets  and 
the  lack  of  facilities  to  allow  crews  to  fire  on  the  move. 

(d)  The  need  to  stabilize  the  TC  and  gunners  and  the  requirement  for  (QL4) 
Increased  training  of  these  key  crewmen  is  supported  by  similar 

conclusions  of  the  M60A1  WSTEA  and  the  judgments  of  commanders  expressed 
in  the  Battalion  Training  Survey  (BTS).  Further,  endemic  instability 
recorded  in  both  Phase  I  of  this  study  and  the  M60A1  WSTEA  highlights  the 
need  for  standardized  training.  The  importance  of  training  tank 
..  -.minders  with  their  gunners  and  the  need  to  implement  policies  to 
s-.thilize  these  soldiers  in  position  warrants  prompt  action. 


(QL3) 


(e)  Results  Indicate  that  unfamiliarity  with  duties  of  the  tank 
commander  and  gunner  has  a  serious  effect  on  Table  VIII  gunnery  per¬ 
formance.  * 

Group  1,  the  control  group,  was  composed  of  crews  which  had  recently 
completed  Table  VIII,  in  their  normally  assigned  tanks.  This  group 
achieved  a  mean  score  of  1135  with  mean  main  gun  target  hits  totalling  5.4 
with  a  mean  of  10.8  seconds  opening  time.  Group  2  was  composed  of  crewmen 
retained  in  their  Table  VIII  positions  but  within  unfamiliar  crews  on 
different  tanks.  This  group  outperformed  slightly  the  control  group. 

Group  4,  with  rapidly  trained  non-llE  gunners  and  loaders,  also 
outperformed  the  control  group.  Only  opening  time  was  slower  at  11.1 
seconds  as  opposed  to  a  mean  of  10.8  seconds  for  the  control  group.  Group 
3,  composed  of  trained  1  IE  crewmen  serving  in  unfamiliar  positions,  was 
markedly  poorer  In  gunner  performance.  Group  3  tank  commanders  had  been 
replaced  by  their  gunners,  and  gunner  positions  were  filled  by  loaders. 
Driver  and  loader  positions  were  filled  with  men  who  had  held  those 
positions  during  the  recently  completed  gunnery  program.  Group  crewmen 
had  not  previously  worked  or  trained  together.  The  mean  gunnery 
performance  as  a  function  of  group  assignment  is  shown  at  Figure  1. 

(Tank  crew  turbulence  test  (draft)  ARI,  June  78,  Page  34) 


Figure  1  Tank  Gunnery  Performance  as  a  Function  of  Group  Assignment 


(1)  Results  highlight  the  following  trends.  Additional  tests  will  be 
required  to  confirm  these  findigs. 

a.  Whole  crew  personnel  familiarity  did  not  have  a  significant  effect 
on  gunner  performance. 

1.  Experience  in  a  particular  position  appears  as  a  significant  C Ql_ 4 ) 
factor  in  gunner  performance. 

2.  The  findings  in  Phase  I  were  supported  in  that  added  emphasis 
on  training  and  stabilizing  tank  commanders  results  in  increased  gunnery 
performance. 

3.  Changing  a  crewman’s  duty  position  without  training  him  for 
his  new  duties  leads  to  markedly  reduced  performance. 

4.  The  armor  crewmen  of  the  test  unit  were  not  adequately  trained  to 
assume  their  new  positions. 

5.  Incorporation  of  nonarmor  personnel  into  crews  as  gunners  and  loader 
did  not  degrade  gunnery  performance.  Baseline  gunnery  performance,  however,  was 
well  below  acceptable  standards. 

6.  Crew  unfamiliarity  with  the  specific  tank  used  on  Table  VIII  appear 
to  have  only  limited  impact  on  gunnery  performance.  This  may  have  been  because 
baseline  turbulence  was  such  that  few  crews  in  the  tested  unit  could  have  train 
for  long  periods  on  an  assigned  tank. 

b.  That  more  research  is  required  to  determine  the  degree  to  which  turbulen 
affects  peformance  on  less  structured  tasks  such  as  Table  IX  and  the  ARTEP. 

3.  Phase  II  unit  training  costs.  This  recapitulation  covers  the 
training  cost  for  the  armor  battalion  to  conduct  the  tank  crew  modular  training 
program  (TCMIP).  Group  IV  (Non-llE  gunners  and  loaders)  costs  of  the  Tank  Crew 
Skills  Training  (TCST)  program  are  listed  separately  and  are  included  in  total 
costs.  Costs  of  turbulence  testing  have  not  been  included  in  order  to  portray 
tank  battalion  tank  gunnery  costs  in  isolation  from  test  activities.  This  is 
believed  to  be  the  more  meaningful  data.  The  overall  cost  of  the  three-day 
modular  training  program,  including  costs  of  people,  ammunition,  and  POL,  is 
depicted  in  Table  1.  Class  IX  fixed  and  variable  base  operations  costs  could  no 
be  determined  due  to  the  short  duration  of  the  test  and  small  sample  size. 


A- 1-7 


Ac  tivity 

Personnel  Costs 
( Incl  MPA) 

Ammunition  Costs  Miles  Driven  Gallons  POL 
M60A1  Other  M60A1  Oth^r 

Total 

*Pretest 

7, 136.99 

— 

240 

— 

300 

— 

7,265.  9 

Table  V 

28,859.65 

70,458. 66 

4320 

4050 

5400 

887 

102,025.2 

Table  VII 

58,962.99 

442,535.40 

9720 

6020 

12,150 

1474 

507,362.9 

Table  VIII 

64,164.25 

164,385.72 

864 

6720 

1080 

1474 

229,634.5 

Group  IV 

14,984.27 

25,779.27 

1177 

639 

1471 

90 

41,436. 5 

Po  st-test 

5,  750.  53 

— 

80 

— 

100 

— 

5,  793.  fj 

Total  Cost 

179.858.69 

705, 159.05 

16401 

18129 

20501 

3925 

893,538.  ] 

Table  1:  Overall  Cost  of  Tank  Crew  Modular  Training  Program. 

*Costs  of  HUMRRO  Analyst's  pay. 

4.  Significant  Army  Training  Study  finding  from  Phase  II.  Analysis 
of  the  technical  report  data  base  reveal  the  following: 

(a)  The  level  of  turbulence  within  the  Phase  II  test  battalion  in  (QL4) 
CONUS  is  consistent  with  turbulence  levels  reported  in  the  M60A1  WSTEA 
study.  Turbulence  of  this  magnitude  at  the  crew/platoon  level  may  have 
precluded  the  establishment  of  an  adequate  baseline  from  which  to  measure 
the  effects  of  turbulence  on  tank  gunnery  performance.  In  other  words, 
the  potential  performance  of  crews  which  have  been  stabilized  through  a 
series  of  tank  gunnery  programs  in  unknown.  This  conclusion  is  reinforced 
by  analysis  of  crew  performance  in  both  studies  wherein  all  groups  fired 
considerably  below  design  capability.  The  Phase  II  baseline  group  in  this 
study  exhibited  a  combined  Heat/Armor  Piercing  Discarding  Sabot  Ph  mean  of 
.536  while  firing  Table  VIII  the  second  time.  The  combined  Heat/APDS  Ph 
mean  of  the  fee  CONUS  battalions  studied  in  the  M60A1  WSTEA  (which 
includes  the  data  of  the  Phase  II  baseline  crew  performance)  is  0.42.  All 
battalions  fired  the  same  range  with  scores  compiled  by  the  division  tank 
gunnery  assistance  team.  An  additional  long-term  study  is  required  to 
establish  the  potential  performance  of  US  M60A1  units  by  testing  the 
effects  of  stability  on  tank  gunnery  performance.  This  study  should  be 
conducted  cn  range  facilities  which  permit  full  crew  interaction  in  the 
*  engagement  sequence;  i.e.,  shoot  on  the  move.  Such  facilities,  available 


A- 1  -8 


at  Fort  Bliss,  TX,  ire  now  being  used  for  the  XM 1  oT  II.  This  effort 
woul  i  confirm  or  deny  the  study  findings  conceri'.ing  the  effects  of 
L oader/ dr iver  turbulence  on  crew  performance  and  highlight  the  TC/gunner 
relationship. 

(  b)  Tne  Mb'iAl  WSTEA  supports  Phase  I  findings  that  tank  commander 
stability  is  significantly  related  to  crew  hit  performance.  Phase  II, 
Group  2,  however,  outperformed  the  baseline  group.  Because  previous  finds 
are  supported  by  a  much  larger  sample  (15  battalions  versus  11  crews),  it 
is  concluded  that  the  Phase  II,  Group  2  performance  is  attributable  to 
chance . 

(c)  Leader  dominance  appears  to  emerge  as  the  single  most  important 
aspect  revealed  by  both  studies.  In  the  M60A1  VSTEA,  past  success  by  tank 
commanders  correlated  with  higher  performance.  In  this  study,  all  groups 
retaining  expe r ioneed  tank  commanders  in  their  positions  significantly 
outperformed  the  one  group  (Group  3)  where  the  commander  was  replaced  by 
the  gunner.  Four  major  lessons  emerge: 

(1)  emphasize  training  of  leaders. 

(2)  Institute  additional  train-up  of  nther  crewmen  in  TC  duties. 
Cross-training  between  gunner/ loader  and  drivers  is  useful,  but  train-up 
appears  to  provide  greater  battlefield  redundancy. 

(3)  Provide  adequate  training  to  any  crewnan  occupying  an  unfamiliar 
position  before  expecting  him  to  perform  the  job.  Modular  training 
packages,  such  as  those  used  with  Phase  II,  Group  4  and  in  Phase  III, 
should  be  employed  to  train-up  1  IE  (19E/F)  non-posi t ion  qualified  crewmen 
as  well  as  non-llE  (19E/F)  replacements. 

(4)  A  need  for  standardization  is  indicated.  All  battalions, 

c  /.mpanies ,  and  platoons,  conduct  gunnery  programs  somewhat  differently  and 
few  exhibit  expected  levels  of  proficiency.  .As  an  example,  Table  VIII 
range  facilities  In  ISARELR  did  not  provide  target  ranges  greater  than 
1425  meters.  Consequently,  all  main  gun  engagements  were  conducted  using 
battefield  gunnery  techniques  (battle  sight  gunnery).  In  CONUS,  targets 
at  ranges  in  excess  of  2000  meters  required  crews  to  employ  precision 
gunnery  techniques  (using  the  rangefinder)  for  a  number  of  engagements. 

In  !'sARHUR,  each  battalion  conducted  table  VIII  as  desired  by  the 
commanders  concerned  in  accordance  with  a  general  prodeedure  established 
by  PSAR.-ILR.  This  procedure  -allowed  platoon  leaders  to  score  their  organic 
crews  with  the  aid  of  pop-up  targets  to  establish  target  effect.  In 
O' 'M'S,  division  level  tank  gunnery  assistance  teams  scored  all  crews.  No 
pop-up  targets  were  available  and,  thus,  variations  In  discriminating 
doubtful  rounds  from  target  lilts  must  be  considered  possible.  Results  of 


the  Tank  crew  baseline  firing  of  Table  VIII  by  all  groups  during  the 
turbulence  study  reveal  that  despite  the  training,  no  group  of 
crews — experienced  or  inexpe r ienced--demonst rated  a  level  of  crew  gunnerv 
experience  that  could  be  viewed  as  combat  ready.  Qual  if  icat  ion.  rates 
ranged  from  20%  to  40%.  Even  the  most  liberal  measure  of  percent  of 
targets  high  reveals  group  performance  did  not  range  beyond  60  percent. 
This  is  consistent  with  data  reported  by  TRANSANA  in  the  M60A1  WSTEA 
wherein  it  was  estimated  that  tank  crew  performance  was  40%  to  50%  below 
potential  combat  effectiveness.  The  need  to  train  tank  crews  to 
proficiency  rapidly  in  emergencies  is  clear.  The  performance  of  Phase  II, 
Group  4,  indicates  that  standarized  training  and  procedures  can,  in  large 
measure,  compensate  for  the  adverse  effects  of  instability.  (This  group 


was  given  3  days  of  highly  standardized  training  amd  subsequently 
demonstrated  the  same  level  of  performance  as  the  baseline  group.  It 
should  be  noted  however,  that  the  baseline  proficiency  was  low.) 

(d)  While  neither  this  study,  nor  the  M601A  WSTEA,  measured  the 
effects  of  lower  mental  group  soldiers  on  performance,  the  Armor  Retention 
Study  and  the  Redeye  Study  indicate  that  lower  mental  category  soldiers  do 
not  retain  proficiency  as  well  as  higher  mental  category  troops.  The 
Armor  Retention  and  Proficiency  Study  sample  revealed  that  83.4%  of  the 
11E  crewnen  entering  the  force  during  the  period  Jan-March  1978  were 
mental  categories  III  and  IV.  (Learning  and  Retention  of  Basic  Armor 
Skills  within  the  institution  I'SAARMC,  Fort  Knox,  Ky ,  May  1  978  page  25). 
This  indicates  that  the  tested  units  may  have  had  a  large  percentage  of 
lower  mental  category  crewmen.  If  so,  the  low  crew  performance  may  be 
partially  attributable  to  this  as  well  as  turbulence  and  inadequate  unit 
training  programs.  Such  a  conclusion  would  be  consistent  with  trends 
established  in  the  referenced  studies. 

5.  Phase  III.  Summary  of  finding. 

Initial  anaylsis  of  the  data  is  listed  below. 

(a)  Overall,  three  of  the  16  crews  qualified. 

(b)  Ot  the  three  qualifying  crews,  one  was  from  the  3-day  training 
group  and  two  were  from  the  1-day.  .All  were  from  the  first  week  of 
training  qualifying  crews. 

(c)  When  scored  in  terms  of  the  percent  of  total  engagements 
successf  ul  1 y  f  i  red  : 

(1)  The  crews  averaged  main  gun  hits  overall. 

(2)  Averaged  over  the  two  training  periods  the  1-dav  group  did 
slightly  better  than  the  3-dav  group. 
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(3)  Averaged  over  training  groups  (1-day  and  3-day) ,  those  from  (QL4) 
the  first  week  did  substantially  better  than  those  from  the 

second . 

(4)  The  1-day  group  did  better  than  the  3-day  in  week  1;  the  (QL4) 
3-day  group  uid  better  that  the  1-day  in  a  week  2. 

(5)  Indications  were  that  the  crew  involved  in  the  first  week  of  (QL4) 
training  were  more  experienced  than  those  in  the  second 

week. 

(6)  Indications  were  that  the  1-day  group  was  slightly  more  (QL 4) 

experienced  than  the  3-day. 

(7)  Training  was  much  better  the  second  week  than  it  was  the  (QL4) 

first . 

(8)  The  Table  VIII  used  was  that  newly  drafted  by  the  Armor  (QL1) 

school.  Firing  and  scoring  requirements  were  more  severe 

than  the  requirements  in  Phase  II  Tank  Crew  Turbulence  Test. 

(d)  Tabular  data  from  Phase  III  firing  is  displayed  in  Tables  2  thru 
%.  -Differences  in  performance  are  not  statistically  signifi¬ 
cant  due  to  the  small  sample  size. 
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TRAINING 

WEEK 

3 -DAY 

TRAINING  GROUP 
1-DAY 

TOTAL 

“1 

1 

r 

i 

i 

1 

1/4 

2/4 

3/8 

1 

1 

i 

i 

2 

0/4 

0/4 

0/8 

1 

1 

i 

TOTAL 

1/8 

2/8 

3/16 

1 

1 

Table  2. 

Relative 

Number 

of  Crews  Qjalifying 

on 

Table 

VIII  By 

Training  Group  and  Training 

Week 

n 

TRAINING 

TRAINING  GROUP 

i 

i 

WEEK 

(N) 

3 -DAY 

(N) 

1-DAY 

(N) 

TOTAL 

! 

1 

r 

i 

1 

(4) 

3.25 

(4) 

4.75 

(8) 

4.0 

i 

i 

2 

(4) 

3.0 

(4) 

2.5 

(8) 

2.  75 

1 

1 

1 

i 

i_ 

TOTAL 

(8) 

3.125 

(8) 

3.625 

(16) 

3.375 

1 

1 

Table  3.  Averaged  Number  of  Table  VIII  Engagements 
Sucessfully  fired  (TGTS  HIT) 
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PROBABILITY  OF  HIT  (Ph)% 

Table  4.  Proportion  of  Table  VIII  Main  Gun  Hits 
(Ph)  by  Training  Group  and  Week  (QL1) 

(e)  The  following  lessons  learned  were  reported  by  personnel 
conducting  the  Phase  III  test: 

(1)  Individual  readiness  training  should  be  Instructor  managed.  (QL4 

fe I f-instruction  Co  the  point  of  self -management  is  not  recommended,  this 
dose  not  Imply  to  the  need  for  complete  one-to-one  training,  but  it  does 

f'oply  that  a  minimum  individual  entry  skill-level  be  tested  by  an 
Instructor,  wh^  then  assigns/signs-of f  on  criterion  performance. 

(2)  Individual  readiness  training  should  be  closely  tied  to  crew  (QL4 
training  requirements.  Individual  skill  requirements  should  be  carefully 
derived  from  crew  skill  requirements  which,  in  turn,  should  be  derived 

from  unit  performance  criteria,  such  as  Table  VIII  and  IX  and  ARTEP. 

(3)  Individual  readiness  training  should  rapidly  progress  to  crew  (QL4 

readiness  training.  Trainees  should  begin  team  exercises  (two-man,  ) 

three-man  and  full  crew)  just  as  soon  as  minimum  qualification  on 
Individual  skills  is  achieved,  this  is  especially  important  when  training 
time  is  short. 
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■  'k.  < cr.  use  so  ■;  j!  i  be  ".i.ie  if  • :  r  y  a. id  si.  n  -  ca  1  iber  tiring 

•  ..  r.  is-  s.  IV;,  -ugh  the  a  iequac  y  j!  su'ist  it-:tes  :  r  service  tiring  is  nor 

•  •*  r  »e  1 1  doc  merited  ,  it.-,  mi t  loo  costs  discourage  frequent  live-fire 

exercises.  ■ ‘iec  luse  repeated  intensive  gunnery  drills  ire  necessary  to 
a  Sieve  proi  ie  iency ,  the  use  of  dry,  suh-cal  iber  or  it  her  sinulted  forms 

f  gunnery  training  are  recom.r, ended . 

i  i  t  t  ,al  v-.r  k  m  :CST  is  necessary.  Ex  -  e  pt  for  the  readiness  tests,  the  (<L-<) 
rr  gr  la  in  its  present  form  is  little  more  than  a  det tiled  outline  for 
training.  Many  of  the  training  aids,  devices  and  materials  recommended 
n.ive  not  be.  n  level  aped.  Also,  variations  of  the  program  ne.-.-s-ary  to 
-d  <te  •  :  ft  e-rent  training  conditions  and  resources  need  t.»  he  -.ore 

-  ■  - 1  -  it  i.  illy  ;  1  imiei  mi  e-val  rated  . 

it  framing  Implement  it  l  >n.  The  most  significant  ir  pi  l<-  at  ion  of  (-JLs) 
the  *  rk  done  i ;  date  with  1TST  pertains  to  strategies  for  implement  at  ion. 
lve  ;.ality  ; £  a  training  program  is  probably  much  less  important  than  the 
care  with  whi-b.  it  is  implemented  or  the  motivation  of  t:ie  trainers  and 
t  ru i nees  . 

<  g)  Limited  planning  rime  and  resources  and  the  urgency  of  on-going  '■  ^.4) 
training  schedules  precluded  the  kind  <>f  controlled  Intervention  required 

•  or  program  eval '-a  t  ion .  The  forms  of  training  being  studied  were  not 
designed  as  systematic  variants  of  TCST;  tank,  crews  were  selected  on  the 
basis  of  availability  rather  than  suitability;  those  who  did  the  training 
differed  in  background,  motivation,  and  familiarity  with  the  program;  and 
1  ive-f ire  criterion  tests  ware  not  compatible  from  Phase  II  and  Phase 
111.  In  short,  study  objectives,  and  evaluation  criteria  accomodated  the 
physical  md  personnel  resources  ivailable  in  each  case.  Moreover,  some 
data  were  rot  collected  that  should  have  been,  and  other  data  were 
incomplete,  missing,  or  unusuable.  Despite  these  shortcomings,  some 

-  one  1  as  t  ms  md  impl ic  it  ions  are  warranted.  Some  are  based  on  data 

:  il looted  and  other  in  informal  observations  or  "lessons  learned."  They 
ire  presented  under  the  hcidings  .jf  training  need,  trilni.ng  results,  the 
trilni'.g  r-gri.n,  md  training  i -.pie  rentat  ton. 

-  h)  Tink  crew  skills  training  program.  (TCST)  is  in  need  of  further  (QLk) 
ie velo^r.vnt  and  evaluation.  Principal  design  features  are,  however,  sound 
r.i  are  to  be  rec,.,:u:, ended  fur  any  such  tank  crewman  skills  training 
;  r  -  r  n  : 

(1)  Individual  readiness  training  should  be  individualized, 
since  there  is  c  >nsi  ierable  .ariatlon  in  the  entry  level 
■••kills  of  trainees,  it  i>  '  nportant  that  each  block  of 
training  be  adapted  to  the  needs  of  the  individual.  This 
should  be  iiign  .ed  by  pretesting  -in  all  skills  unless 
trainees  \re  known  to  be  totally  untrained. 
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(2)  Individual  readiness  training  should  be  performance  based. 
All  training,  whether  knowledge  or  liands-on,  individual  .,r 
crew,  should  begin  with  a  pretest  to  determine  wh;Tt  the 
individual  or  crew  can  and  cannot  do.  More  importantly,  an 
individual/crew  should  not  be  advanced  from  a  module  or 
block  of  instruction  until  proficiency  has  been  demonstrated 
in  a  post-test . 

(i)  The  overall  costs  of  the  one-day  and  three-day  training  modules 
and  Table  VIII  Firings  are  depicted  at  Table  5.  (Rounded  to  nearest 
dollar) 


1st 

2d 

To  t  a  1 

Activity 

week 

week 

Personnel  (Incl  MPA) 

Tank  Crews 

$9,721.00 

$32  5.  00 

$17,926. 00 

Support 

10,615.00 

7,615.00 

13, 2 30. 00 

Subtotal 

20,336.00 

8. 6/- 0.00 

36,15-.  eg 

A.mr.un i  t  ion 

Subtotal 

37,652.00 

37,652.00 

75,304.00 

POL 

M60A1  Tanks 

172.00 

129.00 

3'"  1 . 

Support 

99.00 

97.1 

J  Q7  ■ 

S  a  b  t  o  C  a  1 

S2 71.U0 

s226. 00 

$498.  m 

T'  1  tl.S 

$55,359. 00 

<53, ^  .00  i 

101 ,955. he 

Table  5.  Ovoral 

1  costs  of  1- 

day '3-dav  tr .lining  mod 

ules 

• .  Significant  Army 

Tr  a  in  inp,  Stud 

y  Findings  from  Phase 

III. 

(a)  While  the  sample  si  ze  preclude!  collection  of  statistic 
s :  g-.i  f  tract  lata,  the  results  are  consistent  with  Phase  I  and  Ill  *  i 
and  with  M'l-iAl  WSrhA  data. 

i  h;  Modular  training  was  relatively  successful  when  cond t 
m, .re  gunner v  experienced  tank  commanders.  Phase  III  results  were  1«: 
v.j.  .  Two  T:.a  5  or  differences  exist.  In  the  earlier  eflort, 

experienced  TCs  trained  novice  gunners  rind  1  >adi-rs.  In  this  si  tn.it  i 
n-  ur.nerv  nullified  Ids  taught  non-gunie  r  .■  cuaiitied  (but  t-ir.V 


.  ■<;.  -_-r:  enccc )  gunners  and  loaders.  Secondly,  the  less  experienced  Is  v 
t~.cn  i-j-ircd  to  lead  the  crew  through  a  more  difficult  Table  VIII. 
Viewed  from  this  perspective,  the  results  in  Tables  5  and  b  could  be 
interpreted  as  reinforcing  the  importance  of  training  TC/gunners  togeti 
i::d  the  ■-  >  1  e  of  the  TC  as  key  to  crew  gunnery  performance.  However,  ot 
i  n:- rpret  »c  ions  are  also  possible.  For  this  reason,  final  conclusions 
■>..  -old  he  deferred  until  the  proposed  TEA  '79  tank,  crew  stability  test 
c  O  leted. 


e  x  r  e  r  i  e  • 


c  r  c'  w  p  u  r 
c  :ic  i  re  i  y 
■j  f  :  i  'er 
i  v  e  r  a o 
c  trabili 


i-.p  Tta- 
if  the  : 

Arr.ur  a : 


.Vnilc  success  of  modular  training  has  to  date  been  modest, 

.■ns  that  the  concept  has  promise,  are  reinforced  by  the  "eporte 
ces  of  the  US  .army  Armor  Center  in  training  basic  officers  to  t 
nery  proficiency.  By  emphasizing  gunnery  training,  focused  m 
tor-nance  criteria,  the  Armor  Center  is  training  crews  composed 
of  basic  officers.  Firing  from  tanks  used  by  all  trainees,  th 
erews  are  demonstrating  a  level  of  proficiency  superior  to  the 
t  ink  crew  in  US  ARE 'JR  and  CONUS  and  approaching  the  design 
ty.  While  direct  comparisons  are  not  appropriate  due  to  the 
ces  between  training  programs,  environment,  motivation,  conduct 
II,  ind  between  mental  category  of  crewmen ,  these  results  are 
t.  Ib.  is  data  tends  to  confirm  the  level  of  performance  potent! 

K-Ai  system  with  well  trained,  motivated  high  quality  personnel 
ficer  basic  crew  performance  data  is  shown  at  Figure  2  below. 
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Retention  of  Basic  Armor  Training  Skills  Within  the  Institution  and  Unit, 


RETENTION  TESTING 


TEST  RETEST  RESULTS 


a.  Test  status.  .As  of  31  July  1  978,  both  the  institutional  and  unit 
parts  of  the  study  have  been  completed  and  the  results  published  in  final 
form. 

b.  Responsible  agencies:  Test  plans  were  developed  by  the  1st 
Training  Brigade  (Armor),  Fort  Knox,  KY.  The  Army  Training  Study  System 
Work  Team  at  Fort  Knox,KY,  in  coordination  with  the  Fort  Knox  Field  Unit 
of  ARI,  refined  the  study  plans  and  assisted  in  the  conduct  of  the  test. 
The  overall  study  was  sponsored  by  the  Commander,  US  Army  Armor  Center, 
Fort  Knox,  KY. 

c.  Synopsis  of  test: 

1.  The  basic  design  of  the  study  was:  Given  that  a  soldier  lias 
passed  all  performance  measures  on  the  mid-cycle  test  and  Tank  Skills 
Qualification  Test  (TSQT)  in  order  to  graduate  from  Basic  Armor  Training 
(BAT),  he  was  followed  to  his  first  unit  and  was  readministered  the  same 
tests  under  the  same  conditions  and  to  the  same  standards  in  order  to 
determine  loss  of  proficiency.  Examinees  were  personnel  in  selected  units 
who  had  graduated  from  BAT  during  the  period  16  December  1977  through 
17  March  1978.  Mid-cycle  and  TSOT  score  records  were  available  for  these 


c  r  iduates .  Thus,  personnel  '-.ere  retested  from  two  to  twenty-five  weeks 
liter  r  ideation. 

2.  Performance  by  Demographic  Categories.  The  demographics  analyzed 
were  age,  marital  status,  mental  category,  education  level,  and  career 
intention. 

3.  The  performance  .measures  selected  were  representative  samples  of 
critical  basic  armor  crewman  skill  level  one  performance  requirements. 
Test  areas  included  testing  loader's  duties,  machines  guns,  breechblock, 
tank  gunnery,  general  subjects,  communications,  maintenance,  advanced 
driving,  small  arms,  and  first  aid. 

d.  Description  of  Subtests  -  None 

e .  Sample  size. 

1.  Institutional  Acquisition  and  Retention  Testing:  A  total  of  436 
personnel  were  tested  and  later  retested;  286  on  the  mid-cycle  and  130  of 
these  were  retested  on  the  end-of-cycle  T3QT. 

2.  Unit  Retention  Testing:  A  total  of  270  personnel  were  tracked  to 
the  unit  and  retested  for  retention. 

f.  Summary  of  results,  findings,  and  conclusions. 

1.  Summary  of  Findings:  The  following  significant  findings  were 
reported  by  the  ARTS  S4T: 

(a)  Institutional  Testing: 

•  Approximately  96 a  of  the  BAT  graduates  had  demonstrated  the  (q 
requisite  proficiency  on  all  test  items  prior  to  graduations.  Figure  1 
below  depicts  mid-cycle  test  result  analysis  by  station  and  overall. 


•  Results  comparing  mid-cycle  test  scores  (Go  No  Go  Cr  i  t 
indicate  that  individual  proficiency  was  much  greater  un  those  t*-. 
involving  fewer  subtasks.  Retention  was  reducted  on  those  task- 
multiple,  precise,  sequential  subtasks  and  cognitive  skills  suah 
communications.  While  it  is  logical  to  assume  that  No  Go's  would 
attained  more  often  on  tasks  which  involve  more  subtasks,  the  far 
the  more  Intricate  tasks  involved  interrelationships  any  one  of  w 
could  cause  a  No  Go  should  not  be  ignored  for  actual  skill  comple 
itself  could  have  been  the  cause  of  many  of  the  No  Go's.  Results 
testing  on  the  end  of  course  Tanker  Skills  Qualification  Test  arc 
Figure  2  below : 
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•  Retention  testing  of  both  the  raid-cycle  test  and  SQT  quality 
indlcte  that: 

•  A  high  degree  of  learning  takes  place  within  the  institu-  (QL3) 

tion.  On  average,  96.7  percent  of  mid-cycle  and  96.1  percent  of  TSQT 
performance  responses  were  "Go"  at  the  first  try.  « 

•  Data  indicates  that  communications  tasks  were  least  well  (QL3) 

learned. 

•  Overall,  comparing  raid-cycle  results  with  TSQT  end-of-cycle  (QL3) 
results,  it  is  concluded  that  performance  retention  is  high  for  three 

weeks  in  the  institution. 

•  Distribution  of  436  examinees  across  mental  categories  was  (QL3) 

I  -  3.1%,  II  -  13.4%,  III  -  75.1%,  and  IV  -  8.3%.  Approximately  66 
percent  of  the  examinees  were  high  school  graduates  even  though  83.4%  were 
in  the  lower  mental  groups. 


MENTAL 

CATEGORY 


( b)  Proficiency  and  Retention  Test  Costs 

•  Resources:  A  cost  study  was  accomplished  in  conjunction 

with  the  proficiency  and  retention  study  in  the  institution.  These  costs 
were  developed  for  the  1  IE  and  19E/F  training  programs  as  used  within  the 
1st  Training  Brigade,  Fort  Knox,  KY. 

•  Costs  were  grouped  into  18  categoreis  to  allow  specific 

lesson  plans  to  fall  entirely  into  a  category.  Training  time  not  included 
in  a  lesson  plan  category  was  identified  separately.  Study  assumptions 
i  ncluded ; 

•  Trainee  strength  was  the  optimum  design  fill  (l IE,  15B, 

19E/F  -  15b  in  6  equal  platoons. 
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•  Trainee  grade  structure  was  based  on  normal  rank  distribution  and 
rank  of  trainer  was  the  authorized  rank  from  the  current  TDA. 

•  Other  assumptions,  guidelines,  and  data-sources  were  as  approved 

by  the  TRADOC  Comptroller  and  were  in  accordance  with  ARTS  Training  Resources 
Methodology . 

•  Cost  summaries  for  OSUT  1 LE 10/1 9E 10/1 9F 10  with  aggregate  numbers 
of  trainess  as  summarized  by  MOS  in  the  following  cost  summaries. 


FY  1977  Cost  Per  Trainee 


Course  Number/ MOS  11E 10  OSUT 


13.0  Weeks 
(No rm  Grad  5 , 189) 


Direct  Costs 

OMA 

MPA 

PA 

1. 

Mission  Costs  (814711) 

348 

1,408 

- 

(a)  Pay 

275 

1,408 

- 

(b)  TDY 

1 

- 

- 

(c)  Supplies  &  Equip 

270 

- 

- 

(d)  Other 

2 

— 

— 

2. 

Ammunition 

526 

3. 

Trainee  Pay  &  Alw  (E-l) 

1,565 

9. 

Travel  Pay  to  Course 

125 

5. 

Total  Direct  Costs 

548 

3,098 

526 

Indirect  Costs 

6 . 

Base  Op  ( .B000  -  .P00Q) 

1,052 

276 

7. 

Support  Costs 
(a)  Training  .Aids 

42 

5 

(b)  Other 

91 

64 

8. 

Total  Indirect  Costs 

1,  185 

345 

9. 

Total  Direct  &  Indirect  Costs 

1,733 

3,443 

526 

Aggregate  -  5, 702 

Table  I.  FY  1977  Cost  Per  Trainee  MOS  11E10  13  Meek  Course 
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FY  1977  Cost  Per  Trainee 


14 . 0  Wee  ks 


Course  Number/MOS  19E10  MbOAl  Armor  Crewman 


Direct  Costs 

OMA 

MPA 

'  PA 

1. 

Mission  Costs  (814711) 

547 

1,516 

- 

(a)  Pay 

296 

1,516 

- 

(b)  TDY 

1 

- 

- 

(c)  Supplies  &  Equip 

275 

- 

- 

(d)  Other 

2 

- 

- 

2. 

Ammunition 

1,443 

3. 

Trainee  Pay  &  AIw  (E-l) 

1,685 

4. 

Travel  Pay  to  Course 

125 

5. 

Total  Direct  Costs 

54  7 

3,326 

1,443 

Indirect  Costs 

6. 

Base  Op  ( .B000  -  .P000) 

1,285 

294 

7. 

Support  Costs 

(a)  Training  Aids 

54 

5 

(b)  Other 

98 

69 

8. 

Total  Indirect  Costs 

1,437 

368 

9. 

Total  Direct  &  Indirect  Costs 

2,011 

3,  694 

1,443 

Aggregate  -  7,148 

Table  2.  FY  1977  Cost  Per  Trainee  MOS  19E10  14  Week  Course 


FY  1 

9’7  Cost  Per  Trainee 

U.  0  'Wee^s 

Co  or 

se  .Vj.t. ber/MOS  19F10  Tank  Driver 

OS  CT 

Dire 

ct  Costs 

OMA 

MPA 

PA 

1. 

Mission  Costs  (814711) 

1,  369 

1,  516 

- 

(a)  Pay 

296 

1,  516 

- 

(b)  TOY 

1 

- 

- 

(c)  Supplies  6  Equip 

1,070 

- 

— 

(d)  Other 

2 

■*“ 

3 

2.  • 

Ammunition 

3  b 

3. 

Trainee  Pay  S  AIw  ( E— 1 ) 

1,685 

■* . 

Travel  Pay  to  Course 

125 

5. 

Total  Direct  Costs 

1,369 

3,  326 

86 

Indirect  Costs 

6. 

Base  Op  (.B000  -  .POOO) 

1,216 

294 

7. 

Support  Costs 

(a)  Training  Aids 

54 

5 

(b)  Other 

98 

69 

8. 

Total  Indirect  Costs 

1,368 

368 

9. 

Total  Direct  &  Indirect  Costs 

2,  737 

3,694 

86 

Aggregate  -  6,517 

Table  3.  FY  1977  Cost  Per  Trainee  MOS  19F10  14  Week  Course 
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SUMMARY  RETENTION  IN  UNITS 


2.  Unit  Retention  Testing  Summary  of  Findings  Reported  by  ARTS 


•  Personnel  were  able  to  perform  properly  ( i  .e  ,  receive  (QL3) 
a  "Go"  on  about  80  %  of  basic  armor  skills,  two  to  twenty-five  weeks  atter 
their  assignment  to  the  unit. 

•  The  types  of  skills  showing  relatively  low  performance 
levels  were  map  reading,  M85  machine  gun  and  breechblock  tasks.  The 
majority  of  "No  Go's"  related  to  failure  on  tasks  requiring  cognitive 
skills  involving  reading,  interpreting  and  remembering,  and  sequential 
skills,  indicating  that  these  types  of  skills  are  forgotten  most  rapidly. 
Tills  finding  is  consistent  with  the  institutional  portion  of  this  study 
which  found  that  cognitive  and  sequential  skills  were  most  difficult  to 
learn. 
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•  The  only  demographic  variable  significantly  related  to 
r e t 1 1  v;s  mental  category.  Lever  aptitude  personnel  performed  at  a 
i  igr.if  i--  sntly  lover  level  overall,  and  their  difficulties  were  concen¬ 
trated  ir.  cognitive  tasks  involving  memory  retrieval  and  decision  making 
This  is  consistent  with  trends  and  indicators  reported  in  the 
institutional  study  as  to  performance  by  lower  mental  category  personnel 
These  categories  totaled  79. 2%  of  this  sample  of  270  examinees.  The 
scarcity  of  mental  category  I  &  II  personnel  and  the  preponderance  of 
mental  category  II L  personnel  (70. %%)  are  typical  distributions  of  the 
armor  trainee  population  at  this  time.  (Chapter  V,  page  15.)  Figure  5 
Lei w  ie.iots  performance  loss  by  mental  category. 


CATEGORY 


ME'  TAL 


Re  rf  cr"i«»n<.p  1  jss  i I'nits  by  Mental  Category  (QL3) 


•  No  correlation  was  found  between  time  from  BAT  to  (?L3~) 

arrival  in  a  unit,  and  retention. 

•  A  large  percentage  of  troops  (25%)  had  not  been  CQL 3 ) 

assigned  to  a  tank  since  joining  the  unit.  Further,  28.5%  indicated  that 
although  assigned  to  a  tank  they  had  not  been  assigned  a  crew  position. 

Thus,  53.5%  of  the  270  man  sample  had  not  been  assigned  specific  crew 
duties.  (Chapter  V,  pages  5  &  6) 

•  Training  in  the  unit  did  not  correlate  positively  with  (0L3) 
retention  of  proficiency  exce.'t  that  the  36.7%  who  had  used  TEC  did 
exhibit  slightly  higher  retention.  However,  use  of  TEC  was  not  wide¬ 
spread.  In  all  cases,  those  who  reported  use  of  TEC  had  done  so  only  once 
or  twice.  (Chapter  V,  pages  8-9) 

(3)  ARTS  Summary  of  Findings:  (QL2) 

•  The  demonstrated  loss  of  proficiency  by  mental  category 
III  and  IV  examinees  is  consistent  with  trends  identified  in  the  63C/H 
Test,  the  Tank  Crew  Turbulence  Test  with  judgments  expressed  by  commanders 
on  the  ARTS  Battalion  Training  Survey  to  the  effect  that  low  mental 
category  personnel  require  additional  training  to  maintain  proficiency. 

In  this  context,  additional  training  means  more  frequent  repetition  of 
refresher  training  in  cognitive  and  sequential  type  tasks  in  order  to 
sustain  acceptable  levels  of  proficiency. 


•  The  Lick  of  unit  training  program  effectiveness  on  (')Ll) 

retention  is  consistent  with  similar  findings  in  the  63C/H  Test  and  with 
probability  of  hit  (rh)  data  reported  in  the  M60A1  WSTEA  and  Tank  Crew 
Turbulence  Test.  The  fact  that  all  examinees  had  demonstrated  proficiency 
in  most  tasks  while  in  the  institution  indicates  that  lower  mental 
category  personnel  are  able  to  master  basic  armor  skills  but  require  good, 
well  planned  and  executed  reinforcement  training  in  cognitive  and 
sequential  ta^ks  more  frequently  than  the  par t ic ipa t ing  units  are 

provid ing . 

•  The  high  density  of  lower  mental  category  personnel  ( ) 

entering  the  armor  force  indicates  a  need  to  emphasize  job  performance 
aids,  more  frequent  training,  use  of  instructional  technology  and  detailed 
testing  during  u<= .  el  o  ^mental  testing.  TTiis  is  especially  true  of  the 
future,  as  the  Tank  Crew  Turbulence  Test  and  M60A1  WSTEA  have  Identified 
the  dominance  of  the  tank  commander  in  crew  gunnery  performance.  It  is 
precisely  this  position  which  most  requires  cognitive  and  sequential 
skills  which  decay  the  fastest  for  lower  mental  category  personnel. 

Because  the  lower  mental  categories  form  the  bulk  of  armor  entry  level 
soldiers  it  .ecus  probable  that  they  may  form  the  bulk  of  the  tank 
commanders  in  the  future. 

•  The  high  percentage  of  soldiers  who  had  not  been  (QL4) 

assigned  a  tank  or  had  not  been  assigned  a  specific  crew  position  is 
consistent  with  the  high  degree  of  turbulence  and  not  present  for  duty 

data  collected  during  the  ARTS  "Best  Battalion"  costing  effort  as  well  as 
the  Tank  Crew  Turbulence  and  M60A1  WSTEA  studies.  However,  since  the 
results  indicate  chat  increased  experience  in  a  tank  crew  (at  least  up  to 
25  weeks)  did  not  lead  to  improved  performance,  unit  training  will  have  to 
Improve  in  quality  and  quantity  before  this  malassignment  training 
distractor  becoic.es  dominant.  It  is,  of  course,  a  serious  Impediment  in 
the  development  of  team  proficiency  and  esplrlt,  both  of  which  are 
essential  to  Improve  the  generally  unsatisfactory  performance  of  the  test 
sample . 
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a.  Test  status.  Initial  analysis  of  data  cot.  pie  ted  as  of  3v  June 
197b  nas  been  rnade.  Additional  data  reduction  is  required  to  complete 
correl  t  Ion  of  relationships  between  training  and  combat  ef  tecti vvnv-s 
representative  samples  of  CUNT'S  AND  L'SAk.-TR  MnnAl  tank  crews. 

b.  Responsible  agencies.  The  tests  were  initiated  and  sponsored 
Direct  r,  Army  Training  Study  (ARTS),  and  Comm.an  Jer ,  I'S  Army  Armor  Cer. 
Fort  Re. ox,  KY,  and  completed  by  the  I'S  Army  TkAOU'J  Svs terns  Analysis 
Activity  (TRASANA),  White  Sands  Missile  Range,  NM. 

c.  Synopsis  of  test. 

1.  Objectives.  The  primary  objective  of  the  test  was  to 
determine  the  relationship  between  training  and  combat  effectiveness  I 
COSTS  and  USAREl’R  tank  crews.  Secondary  objectives  included  determini 
the  relationship  between  institutional  and  unit  training  programs  and 
determining  the  relationships  between  personal  history  prior  training 
the  probability  of  main  gun  hit  (Ph)  by  crews  during  tank  Table  VIII 
firing. 


2.  Test  design.  The  measure  of  performance  used  in  this  anil 
was  the  number  of  main  gun  hits  per  rounds  fired  on  Table  VIII.  The 
firing  crewmen  were  administered  the  TRANSANA-designed  Mb'JAl  W'STEA  Tan 
Crew  Personnel  Survey  to  determine  their  personal  history  and  training 
background.  The  Ph  and  survey  data  were  analyzed  to  identify 
relationshi ps  among  the  data  sources.  Because  the  physical 
characteristics  and  conduct  of  I'SARF.TR  and  CONVS  tank  tables  differ,  d 
and  conclusions  are  reported  separately. 

d.  Description  of  subtest s-none . 

3.  Tests  were  conducted  at  the  7th  Army  Training  Center, 

Gr afenwehr ,  Germany  and  on  a  CONUS  divisional  post.  Each  location 
constitutes  a  separate  subtest  and  results  from  one  cannot  be  correlat 
with  the  other.  To  measure  combat  effectiveness  (the  prime  objective'1 
related  to  training  proficiency,  the  Ph  data  derived  from  Table  VIII 
engagements  were  input  to  the  Tank  Exchange  Model  (TXM).  The  scenario 
consisted  of  gaming  MbuAl  tanks  against  T-72  tanks  supported  by  BRDM  w 
S AGGER  missiles.  The  standard  quasi-combat  Ph  (Army  Material  System 
Analysis  Agency  (A.MSAA)  curves)  for  both  forces  was  used  as  the  base  o 
Analysis  was  made  by  quantifying  the  effect  of  actual  CONUS  and  IRAK'' 
on  the  red.  blue  kill  ratio.  The  results  of  the  war  gaming  are  cl  as- if 
confidential  iod  are  available  in  Chapters  2  and  a,  Appendix  C, 

u  hus  USAkFU  R  Hi  t  Data  of  TRASS  ANA  Terhnl'al  Report  4-78. 
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Ni-.ple  sice. 

.  1)  Sample  size:  Data  was  gathered  from  January  to  June  1978  on 
a  :>til  jf  35o  MbOAl  tank  crews  consisting  of  1288  individual  tar.k  crewmen 
Mm  -  MS.  t>26  USAREUR ) .  This  sample  was  drawn  from  a  total  of  four 
_  MS  and  six  USAREUR  tank  ballations.  This  sample  ws  drawn  from  a  total 
f  :  ,-ur  7  M'S  and  six  L'SARE  CR  tank  battalions. 

f.  s,--.ary  of  results,  findings,  and  conclusions. 

M )  Summary  of  findings.  The  following  significant  findings  were 

reported  by  TRASS ANA : 

a ')  MS  US  Me  DA  1  tank  crews  did  not  perform  at  the  quasi-combat  Ph  (QL3) 

*.  «J  '•'c'l  • 

(b)  The  Ph  for  USAREUR  crews  was  higher  than  that  of  CONUS  crews  (QL3) 
engaged  with  battlefield  gunnery  (battle  sights)  techniques. 

M)  The  Ph  for  USAREUR  crews  was  higher  than  the  quasi-combat  Ph  (QL3) 
v.;I  ues  at  the  1  100-1  300  meter  range  band. 

id.'  The  MbJAl  crew  combat  effectiveness  was,  for  CONUS  in  (QL3) 

;  if.;.  »r ,  -  .  to  50  percent  less  than  the  baseline  (quasi-combat  Ph 
v  j  1  .r-  s  '  effectiveness. 

( e )  Seventeen  (17)  and  twenty-one  (21)  percent  of  the  tank  (QL3) 

lets  in  USAREUR  and  CONUS,  respectively,  did  not  know  where  to  aim 
o  i  target  when  engaging  with  batt lesight s . 

\t  )  Twenty-one  (21)  and  twenty-eight  (28)  percent  of  the  gunners  (QL3) 
in  ’ 'SAREUR  and  CONUS,  respectively,  did  not  know  where  to  aim  when 
engaging  a  target  with  battlesights . 

(g)  Thie  strongest  Influence  on  hit  performance  was  past  proven  (QL1) 
amity  and  experience  on  Table  VIII, 

g.  Significant  .Army  Training  Study  Findings:  Analysis  of  the 
technical  report  data  base  and  participant  soldier  comments  reveals  the 

: o i lowing : 

2.  Tu rbul enc e! turnover :  (QL2) 

(a)  The  average  number  of  months  a  crewman  has  been  assigned  to  a 
tank  ompany  was  15.3  months  in  USAREUR  and  16  months  In  CONUS.  However, 
the  -■m:i  time  -the  crew  had  trained  together  was  3.6  months  In  USAREUR  and 
3  moths  in  CONUS.  Further,  the  data  showed  the  mean  crew  position  change 
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to  be  3.7  and  3.6  months  respectively.  while  the  standard  deviation  was 
large  (10  and  6  months  respectively)  for  these  data,  it  was  evident  that 
significant  amount  of  turbulence  within  crews/platoons  was  being 
internally  generated  within  the  unit.  This  conclusion  was  reinforced  by 
data  showing  that  50.6%  of  the  crewcr.eri  did  not  fire  Table  VIII  with  their 
assigned  crew.  Since  over  50%  of  all  crews  rate  training  together  as 
important  (Table  D-2,  page  D-I7)  it  is  reasonable  to  assume  that  this 
turbulence  impacted  negatively  on  Ph .  These  rates  of  turbulence  are 
compatible  with  data  from  the  Tank.  Crew  Turbulence  Test.  Figures  I -3 
portray  this  data. 


(b)  The  data  show  significant  loss  of  whole  crew  training  due  either 
to  crewmen  not  being  assigned  to  a  tank  or  being  absent  from  training. 


CONUS 

NO  ONE 
ASSIGNED 

NEVER 

SELDOM 

HALF  THE 

TIME 

USUALLY 

ALWAYS 

Dr iver 

10% 

2% 

3% 

5% 

19% 

60% 

Loader 

26% 

6% 

8% 

7% 

18% 

1  5% 

Gunner 

7% 

4% 

6% 

8% 

21% 

54% 

Tank  Commander 

1% 

2% 

4% 

3% 

14% 

76% 

US ARE UR 


Dr iver 

5% 

1% 

2% 

5% 

15% 

73% 

Loader 

19% 

4% 

4% 

6% 

16% 

52% 

Gunner 

5% 

3% 

2% 

5% 

17% 

68% 

Tank  Commander 

2% 

3% 

2% 

3% 

11% 

80% 

Table  1.  Percent  of  Crew  Available  for  Training 

3.  Soldier  attitudes.  When  asked  the  question,  In  what  areas  do  you 
feel  your  tank  crew  needs  the  most  training?,  68%  of  the  1288  crew  members 
responded.  Comments  were  largely  negative  with  many  stressing  the  need  to 
keep  crews  together  longer,  fire  more  often  and  to  eliminate  other  activi¬ 
ties  which  result  in  crewmen  not  being  present  for  training.  Further,  a 
need  for  additional  repair  parts  and  enhanced  maintenance  capability  was 
expressed.  The  tone  of  these  comments  indicate  that  poor  training, 
resulting  from  poor  management,  impacts  adversely  on  motivation  and 
-  rile.  In  turn,  this  impacts  on  a  unit's  ability  to  train  to 
pro  f  ic  ioriiey  * 

w.  Training  readiness.  The  standard  used  by  ARTS  to  evaluate  tank 
gunnery  proficiency  is  Ph  essentially  equal  to  the  AMSAA  curve  to  be 
combat  readyl.  Mimimum  acceptable  standards  for  the  tested  units  (all 
forward  deployed  or  early  deploying  units)  should  be  93%  of  the  AMSAA 
irve,  95%  of  the  time.  As  indicated  by  the  TXM  output,  proficiency 
achieved  was  40%  to  50%  below  the  standard. 

5.  A  major  finding  of  this  study  was  that  those  crews  who  had 
previously  fired  well  continued  to  do  so,  and  those  that  did  not, 

:  ur. t  in ued  to  fail.  This  finding  gives  rise  to  a  conclusion  that  the 
valuation  feedback  mechanism  necessary  to  design  and  implement  corrective 
raining  associated  with  tank  Table  VIII  is  not  wholly  effective. 


c\  curves  describe  the  design  capability  of  the  weapons  system  as 
t!  j”.  of  probability  of  hit  ( Ph )  at  various  ranges  under  simulated 
.  i ng  cond i 1 1 ons . 


6.  Frequency  to  proficiency:  As  stated,  commanders  in  the  Battalion 
Training  Survey  expressed  judgments  that  tank  gunnery  training  should  be 
conducted  quarterly.  This  is  supported  by  the  findings  that  large  numbers 
of  tank  commanders  and  gunners  in  CONUS  and  USAREUR  did  not  know  proper 
placement  of  sight  reticles  during  battlefield  gunnery  engagements,  and 
that  a  Ph  of  less  than  0.1  was  attained  by  CONUS  crews  in  precision 
engagements. 

7.  Training  distractors.  The  numerous  crewmen  complaints  as  to  the 
adverse  rmpact  of  outside  influence  on  their  ability  to  train  to 
proficiency  are  reflected  in  the  not  present  for  training  statistics  on 
Table  1.  While  the  data  does  not  discriminate  as  to  the  nature  of  these 
distractors,  it  is  assumed  that  across  the  sample  of  ten  battalions  these 
distractors  are  related  to  guard,  housekeeping,  and  support  requirements 
as  well  as  to  mandatory  training  subjects  not  directly  related  to  tank 
crew  proficiency.  Seventy  percent  (70%)  of  CONUS  crews  (438  crewmen)  nd 
sixty  percent  (60%)  of  USAREUR  crews  (358  crewmen)  stated  that  a  "big 
improvement"  on  Table  VIII  scores  would  result  if  they  could  train  more  as 
a  full  crew. 

8.  The  combination  of  turbulence  and  personnel  not  present  for  train¬ 
ing  has  been  identified  by  commanders  in  the  Battalion  Training  Survey 
(BTS)  as  resulting  in  a  requirement  for  additional  frequency  of  training 
and  additional  training  time  to  maintain  95%  proficiency.  Further,  these 
commanders  have  identified  a  need  to  fire  tank  gunnery  quarterly.  The 
results  of  this  test  support  these  judgments.  Since  it  cannot  be 
concluded  that  these  are  the  only  causative  factors,  a  need  for 
additional  inves t iga t ion  is  indicated. 

Data  on  knowledge  and  general  information  and  actual  Ph ,  particularly 
of  CONUS  crews,  substantiate  that  crewmen  do  not  demonstrate  the  requisite 
gunnery  skills.  Further,  the  already  deficient  USAREUR  Ph  levels 
deteriorated  during  platoon  firing  on  Table  IX  (see  classified  annex, 

Table  3,  Probability  of  Hit,  Table  VIII  versus  Table  IX).  While  further 
re  ;eaeh  is  necessary  to  focus  precisely  on  cause  and  effect,  for  the 
present  it  seems  prudent  to  accept  crew  judgments  and  take  action  to 
reduce  training  distractors  and  turbulence.  This  insight  is  wholly 
oe-sistent  with  the  Battalion  Training  Survey  judgments  emphasizing 
training  at  the  crew/platoon  level,  and  the  personnel  conditions  which 
require  both  more  frequent  and  longer  periods  of  gunnery  training.  Table 
2  depicts  a  comparison  of  the  mean  probability  of  hit  (Ph)  of  tank  crews 
by  rank  of  the  tank  commander.  Comparisons  between  CONUS  and  USAREUR 
cannot  be  made  due  to  differences  in  scoring  procedures  and  range 
facilities.  The  most  distant  target  engaged  by  USAREUR  crews  was  placed 
at  lu25  meters.  Thus,  USAREUR  Ph  is  valid  for  battlesights  engagements 
'inly.  By  contrast  CONUS  crews  were  required  to  engage  targets  out  to 
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(QL4) 


(QL4 ) 
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ranges  of  2150  meters.  The  use  of  Tank.  Gunnery  Assistance  Teams. (TGAT)  in 
CONUS  served  to  impose  a  standard  for  hit  determination  which  was  common 
across  the  sample  in  contrast  to  USAREUR  where  hit  determination 
procedures  and  standards  varied  by  unit. 
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Training  Time  Ratio  Survey 


a.  Test  status  as  of  22  July  1978.  Report  of  the  survey  data 
reduction  has  been  completed  by  Actuarial  Research  Corporation  and  has 
been  forwarded  with  a  narrative  report  to  the  Commander,  USAARMC,  Fort 
Knox,  KY.  The  ARTS,  SWT,  USAARMC  has  completed  its  survey  report  and  has 
provided  it  to  the  Director,  ARTS  Army  Training  Study. 

Selected  data  has  been  withdrawn  from  the  Training  Time  Ratio  Survey 
to  be  used  as  input  to  the  BTM  to  support  sensitivity  analysis  into  the 
effects  of  varying  institutional  training  programs  on  unit  training 
programs . 


b.  Responsible  agencies.  The  test  plan  and  survey  was  developed 
jointly  by  ARTS;  the  ARTS  SWT,  Fort  Knox,  KY ;  and  Actuarial  Research 
Corporation  of  Arlington,  VA.  The  survey  was  conducted  by  the  ARTS  SWT 
under  the  sponsorship  of  the  Commander,  USAARMC,  Fort  Knox,  KY. 

c.  Synopsis  of  test.  The  purpose  of  the  study  was  to  provide  data 
relative  to  the  Impact  on  unit  training  programs  that  would  result  from 
varying  the  length  of  the  Basic  Armor  Training  (BAT)  course.  The  primary 
objective  of  the  effort  was  to  acquire  sufficient  data  to  permit  the  Armor 
School  and  ARTS  to  determine: 

1.  The  ratio  of  unit  individual  to  collective  training  as  a  function  of 
varying  individual  training  time  in  the  training  base  thru  input  to  the 
BTM. 

2.  Individual  levels  of  Armor  crewman  proficiency  resulting  from  varying 
the  lengths  of  training  periods  (12,  14,  15  week  variations  of  BAT),  and 

3.  The  impact  on  unit  readiness  responsibilities  as  a  result  of  varying 
the  lengths  of  training  periods  in  the  institution. 

Individual  proficiency  is  expressed  as  a  percentage  of  Skill  Level  1 
Armor  crewmen  SM  tasks  trained  to  mastery.  Examination  of  BAT  resulted  in 
an  estimation  that  MOS  19E/F  trainees  could  be  trained  to  the  requisite 
levels  of  proficiency  for  Armor  crewnen  critical  tasks  over  time,  as 
ind icated : 


12  weeks  =  70  percent 

14  weeks  =  85  percent  (most  closely 
represents  current  course) 

15  weeks  =  95  percent 

For  any  given  variation  of  the  number  of  weeks  in  the  training  base  it 
was  assumed  that  the  resultant  proficiency  of  the  graduates  would  have 
some  proportionate  effect  on  a  unit's  training  program  and  readiness. 


The  lack  of  meaningful  empirical  data  needed  to  satisfy  the  objectives 
of  the  study  was  acknowledged.  Also  it  was  recognized  that  much  of  the 
desired  information  was  of  the  type  that  could  be  derived  only  from  the 
qualitative  judgments  of  experienced  military  personnel.  For  these 
reasons,  the  medium  of  a  urvey  was  selected  as  the  data  collection 
instrument.  This  survey  was  specifically  designed  to  be  compatible  with 
the  BTS  so  as  to  ensure  interface  with  the  BTM. 

This  survey  uses  a  unique  methodology,  Magnitude-Estimation  Scaling 
(MAG-ES),  to  measure  the  relative  criticality  of  training  Soldier's  Manual 
tasks  for  two  separate  MOS.  The  survey  was  accompained  with  a  guide  book 
listing  131  SM  tasks  for  these  MOS,  19E  (Gunner/Loader ,  and  19F  (driver) 
MOS . 

MAG-ES  provides  a  weighted,  quantified,  prioritization  of  the  issues  that 
reflect  the  collective  perceptions  or  value  judgments  of  experienced 
military  personnel  with  respect  to  subjective  issues  such  as  "criticality" 
of  training.  The  weighted  priorities  provide  the  decision  maker  with 
guidance  for  adjusting  training  programs  in  accordance  with  changes  in 
available  resources. 

Each  of  the  respondents  was  asked  to  complete  an  anonymous  questionnaire 
relative  to  pertinent  biographical  information.  The  purpose  of  this 
information  is  to  establish  the  credentials  of  the  respondent  and 
ascertain  whether  he  has  sufficient  background  to  participate  in  the 
survey. 

d.  Description  of  subtests:  None. 

e.  Sample  size. 

1.  Sample  size.  A  total  of  63  officers  and  NCOs  from  four  CONUS 
Armor  Battalions  participated.  The  sample  was  broken  down  by  position  as 
follows : 


POSITION  SAMPLE 

BN  CM DR  -  2 

BN  XO  -  1 

BN  S3  -  4 

Company  Gndr  -10 

CSM  -  1 

Pit  Leader  -20 

Pic  Sergeant  -28 

SQD  Leader  l 


2.  Reliance  on  the  training  time  survey  data  and  the  resultant 
findings  must  take  into  consideration  the  following  relative  to  the 

su"  p  1  e 
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(a)  Sample  size — the  average  sample  for  most  questions  was  51  to  53 
responses  (out  of  a  total  of  63  respondents).  This  sample  decreased  even 
further  when  collective  training  as  opposed  to  individual  training  was  the 
subject  for  questions. 

(b)  Experience — since  the  responses  were  to  be  "best  professional 
estimates,”  the  experience  factor  of  the  interviewees  was  not  ideal.  Of 
the  23  E6/E7  h’COs  ,  17  (73  percent)  had  less  than  six  years  armor 
experience  (52  percent  had  less  than  two  years).  Of  the  34  junior 
officers,  28  (82  percent)  had  less  than  six  years  experience  (64  percent 
had  less  Chan  two  years;  one  2LT  had  been  on  active  duty  two  months). 

(c)  Organization — all  personnel  interviewed  were  from  one  division's 
four  armor  battalions,  which  possibly  induced  bias  of  some  order  into  the 
responses . 

(d)  Because  of  these  limitations,  survey  data  provide  limited 
insights  only  based  on  mathematical  extrapolations.  Therefore,  all  data 
should  be  considered  as  rates  at  ARTS  Quality  Level  (QL)  4. 

f.  Summary  of  results,  findings  and  conclusions. 

1.  Summary  of  results. 

The  results  of  six  of  the  seven-part  survey  are  reported  in  four 
topical  categories.  The  results  of  Set  7,  "Training  Survey,”  are  being 
used  separately  by  the  Armor  School. 

The  four  categories  consist  of  the  following: 

(a)  SM  task  ratings.  -  the  separate  weighted  prioritization  of 
Soldier's  Manual  task  generic  groupings  for  19E  and  19F  MOS  by  Magnitude- 
Estimation  Scaling:  Set  I. 

(b)  Training  of  unit  replacements  -  the  measurement  of  the  impact  of 
unit  training  of  replacements  who  are  BAT  graduates  of  courses  varying  in 
length  from  12  to  15  weeks;  (Set  II)  corresponding  to  70,  85  and  95 
percent  proficiency  in  SM  SL1  Tasks. 

(c)  Times  and  frequencies.  -  Estimates  of  the  number  of  hours  and  the 
number  of  repetitions  per  year  to  train  specific  Soldier's  Manual  Tasks 
for  the  19E  and  19F  MOS,  collective  tasks,  and  ARTEP  missions  (Sets  III, 

V,  &  VI). 

(d)  Training  strategies.-  selection  of  alternative  approaches  for 
unit  training  of  soldiers  with  varying  degrees  of  background  or  experience 
in  the  subject  matter. 

Each  topic  is  discussed  separately. 

(a)  SM  task  ratings 
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4 


(QL4) 


Using  the  Magnitude-Estimation  Scaling  (MAG-ES)  metholology,  the 
respondents  were  asked  to  rate  the  relative  criticality  of  training  for 
the  19  functional  SM  task  groups.  The  context  for  comparing  the  items  was 
that  training  must  be  accomplished  to  enable  the  Army  "to  fight  any  place 
at  any  time." 

Tables  1  and  2  summarize  the  ratings  in  the  form  of  weighted 
prioritizations  of  the  19  Soldier's  Manual  Tasks  for  the  19E  and  19F  MOS 
respectively.  The  tasks  are  presented  in  descending  order  of  criticality. 
The  relative  weights  are  displayed  graphically  in  Figures  1  and  2. 


Rank 

Order 

1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 
19 


Relative 

19E  Soldier's  Manual  Tasks _  Weight 

Tank  &  Crew  Weapons  Employment  5.2 

Gunnery  Preparations  5. 1 

Turret  Maintenance  Procedures  4.0 

Combat  Skills  3.8 

Crew  Served  Weapons  Maintenance  3.5 

Map  Reading  2.7 

Individual  Weapons  Maintenance  &  Employment  2.4 
General  Maintenance  Procedures  2.3 

Driver  Tactical  Operating  Procedures  2.2 

Hull  Maintenance  Procedures  2. 1 

Individual  NBC  Procedures  2.0 

Driver  Mechanical  Operating  Procedures  1.8 

Communications  Equipment  Operations  &  1.7 

Maintenance 

Collective  NBC  Procedures  1.6 

Tank  Recovery  Procedures  1.5 

Intelligence  and  Security  Procedures  1.4 

Communications  Message  Handling  Procedures  1.2 
First  Aid  1.2 

land  Mine  Warefare  Procedures  1.0 


TABLE  1 

RELATIVE  CRITICALITY  OF  SOLDIER'S  MANUAL  TASKS 
19E  (Gunner/Loader) 
n  =  63 


4 
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Rank 

Order 


19F  Soldier's  Manual  Tasks 


Relative 

Weight 


1  Driver  Tactical  Operating  Procedures  5.1 

2  Driver  Mechanical  Operating  Procedures  4.2 

3  General  Maintenance  Procedures  4. 1 

4  Hull  Maintenance  Procedures  3.9 

5  Combat  Skills  3.2 

6  Tank  Recovery  Procedures  3.2 

7  Tank  and  Crew  Weapons  Employment  2.7 

8  Map  Reading  2.5 

9  Gunnery  Preparations  2.4 

10  Crew  Served  Weapons  Maintenance  1.9 

11  Individual  NBC  Procedures  1.7 

12  Individual  Weapons  Maintenance  and  1.6 

Employment 

13  Collective  NBC  Procedures  1.6 

14  Turret  Maintenance  Procedures  1.5 

15  Land  Mine  Warfare  Procedures  1.3 

16  Communications  Equipment  Operations 

Maintenance  1.3 

17  Communications  Messagee  Handling 

Procedures  1.1 

18  Intelligence  and  Security  Procedures  1.1 

19  First  Aid  1.0 


TABLE  2 

RELATIVE  CRITICALLITY  OF  SOLDIER'S  MANUAL  TASKS* 
19F  (Driver) 
n  =  63 

CAUTION 


The  weights  for  each  MOS  cannot  be  compared  directly,  e.g.,  a  rating  of 
1.0  for  19E  is  not  identical  to  1.0  for  19F.  Hence,  the  weights  are  not 
to  be  compared  except  where  specifically  stated. 


ITEM  IDENTIFICATION  NUMBER 
N  =  63 


T.ll 


With  respect  to  the  19K  MOS ,  respondents  col Lee  ti  vei  y 
No.  4,  Tank  and  Crew  'Weapons  Employment  ,  as  the  most  critical  tr  •:  in :  ng 
issue  with  a  relative  weight  of  5.2.  'Hie  weight  can  be  interpreted  i , 
being  5.2  times  more  critical  than  the  lowest  rated  item,  i.e.,  Ta > 

No.  3,  Land  Nine  Warfare  Procedures,  with  a  weight  o  f  1.0.  Converse- •  , 
t  he  lowest  item  can  be  considered  t  )  be  19  percent  as  critical  as  t  •  •• 
h  i  g  he  s  t . 

Because  MAG-ES  establishes  ratios  among  each  of  the  tusks  ,  the  sa-  •• 
logic  applies  between  any  two  items,  e.g.  ,  Task  In  (wt  .  4.0)  is  two  o:  e-- 
more  critical  than  Task  11  (wt.  2.0);  Tasks  9  and  b  wit!,  identical  -e.t,,t 
are  50'’  as  critical  as  Task  12. 

There  is  no  limitation  on  the  number  of  items  that  may  be  ’edged  by 
the  respondents  as  being  of  equal  criticality. 

As  might  be  expected  gunner  /  loader  operational  activities  received  tr. 
greatest  emphasis.  Maintenance  procedures  also  rate  relatively  high. 

Since  the  weights  are  additive  it  is  possible  to  group  all  operations 
tasks  ur.d  all  maintenance  tasks  separately  and  compare  the  weights.  Ar.y 
imbalance  in  the  number  of  items,  e.g.,  3  operational  and  5  maintenance , 
may  be  nullified  by  dividing  the  sum  of  the  weights  by  the  number  to 
derive  an  "average  criticality"  factor.  The  factors  may  then  be  readily 
c  on pa  red  . 

The  1 9F  ratings  clearly  show  the  stress  on  the  operational  and 
maintenance  aspects  of  the  driver  with  Item  No.  19  (wt .  5.1)  being  the 
highest  and  Item  No.  b  (wt .  l.u)  the  lowest.  These  ratings  appear  to  be 
in  keeping  with  the  requirements  of  the  MOS. 

Since  the  Soldier's  Manual  Tasks  are  identical  for  both  MOS,  a 
comparison  was  made  of  the  1 9E  and  1 9F  ratings  as  shown  in  Figure  3.  Not 
that  a  scale  change  from  weights  to  percentage  weights  was  necessary  to 
affect  the  comparison. 

The  comparison  in  Figure  3  clearly  demonstrates  the  difference  in 
flows  between  the  two  MOS.  Tlrose  items  for  which  very  little  difference 
is  noticed  are  for  the  most  part  general  tasks. 


percentage  weights 


a.  . 


Figure  3. 


ITEM  IDENTIFICATION  NUMBER 

Comparison  of  Ratings  for  Soldier's  Manual 
Tasks  19E  versus  I9F  (QL4) 


The  weights  provide  the  training  planner  with  unusual  guidance  for 
designing  programs  that  meet  the  needs  of  the  respective  MOS.  It  is  now 
possible  to  stress  the  more  critical  tasks  providing  that  training  in  the 
less  critical  are  not  totally  forgotten  or  unduly  jeopardized.  The 
capability  for  adjusting  schedules  more  precisely  in  the  event  of  imposed 
resource  constraints  is  provided. 

The  reader  is  cautioned,  however,  not  to  equate  priorities  with  cost 
of  training.  A  very  critical  task  may  be  relatively  inexpensive  to  train 
whereas  a  very  low  rated  item  may  be  very  costly.  A  knowledge  of  unit 
training  costs  in  conjunction  with  the  weights  is  essential  in  conducting 
the  trade-offs. 

( b)  Training  of  unit  replacements. 

This  portion  of  the  survey  attempted  to  measure  the  impact  on  unit 
(.raining  that  would  be  incurred  by  the  inflow  of  Basic  Armor  Training 
(BAT)  graduates.  Two  variables  are  associated  with  the  BAT  replacements: 


/V  V1 


a.  The  length  of  their  BAT  coarse,  i  .e . ,  12,  14,  or  15  week  courses, 
factors  that  for  the  purpose  of  this  study  are  associated  with  proficiency 
levels  of  70,  85,  and  95  percent  respectively;  and 

b.  The  rate  of  replacement  input,  parametrically  assumed  to  be  10, 

15,  and  20  percent  per  quarter. 

The  respondents  were  asked  to  estimate  the  additional  amount  of  time 
that  would  be  required  to  train  replacements  with  less  BAT  background  and 
at  increasing  influx  rates.  These  estimates  were  then  converted  to 
general  first-order  multiplication  factors  that  could  be  used  to  adjust 
training  schedule  frequencies  in  accordance  with  the  entry  conditions. 

Figure  4  depicts  the  adjustment  curves  for  the  three  types  of  BAT 
training  courses,  i.e.,  a  12,  14,  or  15  week  course.  Note  that  the  slope 
of  the  straight  line  approximations  increases  as  the  length  of  the  course 
decreases.  In  other  words  the  incremental  increase  in  training  require¬ 
ments  rises  as  the  preparation  of  the  replacement  decreases.  This 
condition  obviously  creates  a  greater  burden  on  the  unit,  especially  as 
the  replacement  rate  increases. 

,  v'  .  et  ;  -  :  c  . s  ut  ’  i  -  ,  :  le  :r  -f; 

•SO©  . .  *.  \.  ei  ee  i  >  s  ■: 

.2, 


'  p 

:  i  «*£  •  .  Jit- 
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The  adjustment  factor  scale  is  valid  only  if  the  base  condition,  i .e . , 
the  set  of  unit  personnel  conditions  for  which  the  frequency  of  training 
is  based,  happens  to  be  10  percent  replacement  rate  of  15  week  BAT 
graduates.  If  the  frequencies,  however,  are  based  on  another  set  of 
conditions,  e.g.,  15  percent  replacement  rate  of  14  week  graduates,  the 
scale  must  be  changed.  In  the  latter  case,  all  data  points  would  be 
normalized  or  divided  by  2.0.  The  1.0  would  become  0.5  and  the  3.0,  1.5. 
Any  base  condition  within  the  range  of  empirical  data  shown  may  be  used  as 
the  new  normalization  point. 

(c)  Times  and  Frequencies 

The  respondents  were  asked  to  estimate  the  number  of  hours  per  period 
and  the  number  of  periods  per  year  that  would  be  required  for  training  the 
1 9E  and  1 9F  Soldier's  Manual  Tasks  (Set  III  of  the  Questionnaire) 
collective  tasks,  (Set  V)  and  ARTEP  missions  (Set  VI).  Base  conditions 
representative  of  unit  personnel  training  detractors,  e.g.,  turbulence, 
were  specified  for  each  group. 

Initial  tabulations  revealed  a  generally  wide  range  of  responses  for 
any  given  subject.  Some  of  the  responses  were  obviously  excessive  and 
beyond  the  realm  of  practicality.  To  reduce  the  effects  of  the  extreme 
responses,  and  hence,  possible  severe  distortions  in  the  data,  an 
adjustment  technique  was  employed. 

All  responses  beyond  the  arithmetic  mean  plus  one  standard  deviation 
were  eliminated  and  new  means  computed.  The  disadvantage  of  this  approach 
is  the  loss  of  some  responses  from  the  data  base.  In  view  of  the  improved 
stability  of  the  data,  however,  the  overall  impact  was  believed  to  be 
minimal . 

T^e  data  for  all  three  subjects  has  been  summarized  in  tabular  form 
and  adjustment  factors  applied  for  the  full  range  of  BAT  replacement 
conditions  set  forth  in  Set  II,  i.e.,  12,  14,  and  15  week  BAT  graduate 
replacements  at  rates  of  10,  15,  and  20  percent  —  9  cases  overall. 
Products  of  time  .and  frequency  as  well  as  confidence  levels  are  given 
a  1  so . 

With  respect  to  collective  task  and  ARTEP  mission  estimates,  values 
are  given  for  squad,  platoon,  company,  and  battalion  level. 

(d)  Training  Strategies. 

The  training  status  of  an  individual  in  a  unit  probably  can  be 
classified  according  to  one  of  the  following  with  respect  to  any 
particular  subject  matter: 
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trained  and  experienced  -  Code  I 


3  Trained  but  inexperienced  -  Code  II 

3  Trained  hut  requires  supervision 

(high  decay)  -  Code  III 


'_nt rained  in  the  subject 


-  Code  IV 


At  any  one  time  the  unit  "nav  have  any  combination  of  the  above 
represented.  In  order  to  accomplish  effective,  meaningful  training,  the 
trainer  must  somehow  accommodate  to  the  situation. 

Six  alternative  approaches  were  postulated  by  the  Armor  School  and 
presented  to  the  respondents  for  their  consideration. 

The  training  approaches  are: 

i.  Two  separate  periods  of  formal  training  —  one 
for  initial  training  and  one  for  retraining. 


One  formal  period  oriented  to  those  who  need 
retraining  with  self-paced/off  duty  instuc- 
tions  for  the  initial  learners. 

One  formal  period  oriented  to  those  who  need 
initial  training  --  with  those  who  do  not  need 
retraining  being  released  for  other  activity 
early. 

'Vie  formal  period  oriented  toward  those  who 
r.eed  initial  training  —  all  members  attend 
participate  in  the  entire  training  per- 


Two  formal  training  periods:  Period  One 
, riented  to  and  attended  by  initial 
ie  li  ners  only.  Period  Two  oriented 
t  ward  all  members  and  attended  by  the 
•  ■  •’  t  i  re  uni  t  . 

V.  change  from  current  training  policy. 
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The  se/enth  category,  "Other",  solicited  suggestions  and  remarks.  (The 
latter  are  being  summarized  for  use  by  the  Armor  School.)  Given  seven 
combinations  of  training  status  classifications,  the  respondents  were 
asked  to  select  the  approach  or  strategy  they  believed  would  best 
accomplish  the  objective  for  unit  training  of  Soldier's  Manual  Tasks. 

Three  aspects  of  training  were  posed.  19E  -  Gunnery  subjects,  1 9F  - 
Dt iver  subjects,  and  General  subjects. 

Tables  5,  6,  and  7,  summarize  by  frequency  of  response  the  most 
desirable  strategy  for  any  one  grouping  of  individuals. 

The  approach  with  the  greatest  percentage  of  responses  may  be  assumed 
to  be  the  most  desirable  although  for  Groups  I  &  IV,  two  approaches,  3, 
and  5,  and  Groups  III  &  IV,  two  approaches,  1,  and  4,  were  consistently 
rated  at  almost  equal  frequencies. 


Training 

Training 

Status 

Classification  Group  Codes 

III  &  IV 

Approach 

I  &  II 

I  &  III 

I  &  IV 

I,  II  &  IV 

II  &  III 

II  &  IV 

1. 

5.  5 

7.3 

12.  1 

13.  8 

20.0 

23.2 

33.9 

2. 

30.9 

18.2 

5.2 

6.9 

9.  1 

8.9 

5.4 

3 

36.4 

27.  3 

32.8 

12.  1 

14.5 

7.1 

1.8 

4 

12.  7 

14.  5 

8.6 

22.4 

34.5 

21.4 

32.  1 

5. 

5.5 

23.6 

36.2 

41.4 

16.4 

33.9 

21.4 

6. 

3.6 

1.8 

1.7 

— 

— 

— 

— 

7. 

5.  5 

7.3 

3.4 

3.4 

5.5 

5.4 

5.4 

n 

55 

55 

58 

55 

55 

56 

56 

TABLE  5,  TRAINING  STRATEGIES  FOR  GUNNERY  SUBJECTS  (I9E) 
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Training 

Training 

Status 

Classification  Group 

Codes 

Approach 

i  &  ii 

I  &  III 

I  &  IV 

I,  II  &  IV 

II  &  III 

II  &  -IV 

III  h  IV 

1. 

7.0 

5.  3 

10.  3 

8.6 

20.  8 

10.  5 

31.6 

2. 

22.  8 

14.  0 

5.2 

6.  9 

11.3 

12.  3 

5.  3 

3 

31.6 

40.4 

34.  5 

25.9 

18.  9 

14.0 

8.  8 

4 

19.  3 

12.  3 

10.  3 

17.2 

28.  3 

19.  3 

29.  8 

5. 

8.  8 

21.  1 

37.9 

39.  7 

17.0 

42.  1 

22.  8 

6. 

7.0 

1.8 

— 

— 

— 

— 

— 

7. 

3.  5 

5.  3 

1.  7 

1.  7 

3.8 

1.8 

1.8 

n 

37 

57 

58 

58 

53 

57 

57 

TABLE  6. 

TRAINING 

;  STRATEGIES  for  DRIVER  SUBJECTS  ( 1 9F ) 

Tr  aining 

Training 

Status 

Classification  Group 

Codes 

Approach 

I  &  II 

I  &  III 

I  &  IV 

I,  II  &  IV 

II  &  III 

II  &  IV 

III  &  IV 
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I. 

3.  6 

7.3 

15.  3 

10.  5 

14.  3 

20.  7 

27.6 

2. 

29.  1 

16.4 

11.9 

7.0 

17.  9 

6.9 

3.4 

3 

34.  5 

32.  7 

28.8 

26.  3 

19.6 

10.  3 

1  .3 

4 

14.  5 

16.4 

11.9 

22.  8 

28.  6 

22.  4 

37.  9 

5. 

5.  5 

20.0 

27.  1 

28.  1 

12.  5 

34.  5 

17.2 

6. 

5.  5 

3.  6 

1.7 

1.8 

3.6 

1.7 

1.7 

7. 

7.  3 

3.  6 

3.4 

3.  5 

3.6 

3.4 

1.  7 

n 

55 

55 

59 

57 

56 

58 

58 

TABLE  7.  TRAINING  STRATEGIES  for  GENERAL  SUBJECTS 


2.  Signiricant  Army  Training  Study  Findngs.  Analysis  of  the  data 
reveals  the  following: 

(a)  Results  of  the  training  Time  Ratio  survey  are  compatible  with 
results  of  the  Battalion  Training  Survey  ( BTS ) . 

^  b)  Limitations  i -.posed  by  sample  size  and  survey  techniques 
limit  usefulness  of  the  data  to  no  more  than  insights  as  to  the  effects  of 
changing  training  base  capabilities  of  unit  training  programs.  However, 
as  a  technique  this  should  be  considered  a  significant  advance  in  data 
collection  methodology. 

(c)  Survey  respondents  were  asked  to  determine  the  length  of 
instructional  periods  and  frequency  required  without  consideration  of 
available  training  days  and  without  placing  their  answers  into  the  context 
of  a  comprehensive  program.  This  is  the  reason  that  "required"  hours 
often  total  mure  than  available  training  hours.  The  integration  of  these 
"required"  hours  with  available  hours  is  done  by  the  3TM  in  a 
pre-processing  module.  The  integrated  (reduced)  program  is  then  included 
in  the  Battalion  Annual  Training  program.  IXie  to  time  constraints  and 
computer  capacity  limitations,  a  sensitivity  analysis  will  not  be  complete 
*lth  the  basic  ARTS  report.  Upon  completion,  the  results  will  more 
accurately  define  the  efforts  of  a  reduction  (or  increase)  in  the  quality 
of  BAT  graduates  on  unit  training  costs,  programs,  and  proficiency. 

In  the  interim,  rhis  data  can  be  used  to  gauge  the  the  relative 
,  ig  '.itude  of  importance  placed  on  quality  of  BAT  graduates  on  various 
ispects  of  unit  training.  To  consider  this  data  in  formulation  of 
-r>ining  policies  is,  at  this  time,  attaching  unwarranted  significance  to 
the  study's  restricted  sample  size.  However,  by  administering  the  survey 
to  m  expa-ded  sample,  more  representative  of  the  user  population  during 
•he  ARTS  II  period,  valuable  data  can  be  collected  in  support  of  the 
ih  /el  •  pm •  * u t  of  the  B7M.  To  more  precisely  focus  on  the  quality  of  BAT 
gr ■  ■ '  ■ :  >  t  ■  ■  s  is  i  function  of  training  time  in  the  institution,  the  Armor 
li’-ur  should  include  testing  course  length  variations  during  the 

-  .-I  proficiency  and  retention  studies  recommended  in  TEA  '79. 
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a.  Status  of  test.  Initial  analysis  of  data  completed  as  of  r>  July 
i 9 7 c .  Additional  data  reduction  and  analysis  to  be  accompl i shed  to 
complete  correlation  of  Reserve  Component  Redeye  training  and  employment 
of  the  Redeye  Launch  Simulator  (RELS)  following  -'onpiet ion  of  testing  on 
30  July  1978. 

b.  Responsible  agencies.  The  tests  were  initiated  and  sponsored  by 
director,  Army  Training  Study  (ARTS),  Fort  Belvoir ,  VA,  and  Com  rar.de  r ,  US 
Army  Air  Defense  Center  and  School  (USAADCS),  with  assistance  from  the  US 
Army  fRAbOC  Systems  Analysis  Activity  ( TkASA NA ) ,  white  Sands  Missile 
-.age,  NM. 

c.  Synopsis  of  test. 

1.  ubjective.  The  primary  objective  of  this  test  was  to  identify  the 
critical  training  factors  in  Man-Portable  Air  Defense  Systems  (MAh PADS ) 
whi'h  result  in  degradation  of  the  systems .  Training  in  both  t he  institu¬ 
tion  and  the  unit  is  addressed . 

1,  Test  design.  The  measure  of  performance^  used  in  the  test 
included  probability  of  hit  ( Ph )  as  scored  bv  the  tracking  head  trainer  or 
range  officer.  Data  addressing  proper  use  of  range  ring  profile  and 
attitud  inal  data  c  ji.ceming  the  value  of  the  Redeye  launch  simulator 
(kr.LS)  and/or  Kedi.yo  live  firing  results  were  le-cted  in  this  test. 


In  addition,  comparisons  wore  made  of  the  number  of  aircraft  destroyed 
as  a  function  of  gunner  proficiency  using  selected  war  models.  The  kedeye 
crewmen  were  given  a  written  test  which  measured  their  knowledge  of  the 
use  of  the  range  ring  profile  and  were  then  graded  on  five  aircraft 
engagement  simulations  in  the  moving  target  simulator  (MTS).  Demographic 
and  attitudinal  data  were  also  collected  from  all  gunners. 

d.  Description  of  subtests.  Unit  tests  were  conducted  in  Active  and 
Reserve  Component,  FORSCOM,  I'SAREUR,  and  8th  Army  units.  Also  tested  were 
selected  US  Marine  students  at  Fort  Bliss,  TX.  Data  needed  to  develop 
cost  factors  for  training  devices,  to  allow  for  analysis  of  training 
programs  and  to  evaluate  soldier's  manual/ARTEP  tasks  were  also  collected. 
Existing  air  defense  war  models  were  examined  for  adequacy  with  regard  to 
support  of  training  evaluations.  Simulator  training  was  examined  to 
uetermine  proficiency  increases  and  retention  and  decay  curves  which  could 
optimize  simulator  use.  Personnel  instability  was  examined  to  determine 
its  effect  on  proficiency,  morale,  and  soldier  attitudes.  The  level  of 
proficiency  on  Redeye  atained  by  lower  mental  category  personnel  was  also 
examined.  Finally,  Reserve  Component  training  in  both  the  institution  and 
unit  was  examined  to  determine  possible  alternative  training  programs. 

Additional  investigations  addressed  interoperability  factors  through  the 
use  of  Redeye  by  the  German  Air  Defense  Forces,  and  the  value  of  the  RELS 
versus  live  Redeye  firing. 

e.  Sample  size.  Redeye  test  effort  sample  size. 

1.  Redeye  USTEA  991  gunners. 

d.  Redeye  ARTS  1518  gunners. 

i.  Summary  of  results,  findings,  and  conclusions. 

1.  Summary  of  results  by  test  agency.  Conclusions  on  resources  to 
training  programs. 

(a)  Current  resources  for  Redeye  training  are  required  if  proficiency  (QL3) 
is  to  be  maintained. 

(b)  Additional  moving  target  simulators  (MTS)  and  tracking  head  (QL3) 

trainers  (THT)  are  required  to  provide  increased  "hands-on”  training 
capability  for  lower  mental  category  personnel,  who,  as  has  been  shown, 
requfred  more  frequent  refresher  training  to  maintain  acceptable  levels  of 

pro  f ic  iency  . 

(c)  The  allocation  of  live  rounds  for  annual  service  practice  (ASP)  (QL3) 
should  be  one  Redeye/section/year  as  recommended  in  the  Redeye  WSTEA. 

d.  Conclusions  on  Training  Programs  to  Proficiency: 


/Cm.  jC*.  Jt"*. 
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(a)  Three  additional  hours  of  MTS  training,  which  were  implemented 
following  the  WSTEA  recommendations,  resulted  in  a  slight  increase  in 
proficiency  during  ARTS  tests.  Actual  benefit,  however,  was  not  apparent 
because  of  the  lower  AFQT  scores  of  the  ARTS  test  subjects  when  compared 
to  the  WSTEA  subjects. 
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(b)  The  markedly  lower  range  ring  profile  (RRP)  proficiency  for  ARTS  (0L3) 
subjects  was  attributed  to  the  lower  AFQT  scores.  A  direct  relationship 
between  RRP  and  AFQT  score  was  demonstrated. 
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Figure  3.  AFQT  and  RRP  Proficiency  Mean 
Scores  for  AIT  Classes  (QL2) 


(c)  Mental  category  IV  gunners  achieved  an  acceptable  level  of  (QL3) 

proficiency  on  the  MTS. 

(d)  Determination  of  range  ring  coverage  is  the  most  difficult  task  (QL3) 
for  all  gunners  of  all  categories. 
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I  a )  The  KELS  training  package  is  an  eftective  training  aid  to  reduce  (QL4) 
tear  and  build  confidence.  Chile  it  may  be  too  late  in  the  Redeye  life 
cycle  to  acquire  the  kELS,  the  stinger  launch  simulator  (STELS)  would  be 
effective  as  a  training  aid. 

(b)  Less  than  one  half  of  the  Redeye  gunners  are  satisfied  with  their  (QL1) 
work  assignments  and  working  conditions  and  over  50  percent  of  these 

g  :aners  do  not  plan  to  reenlist. 

(c)  Eased  on  questionnaire  responses,  the  turnover  rate  of  Redeye  ( QL 3 ) 

gunners  is  approximately  30  percent  per  year.  Based  upon  the  number  of 
gunners  available  for  retesting  in  the  units  visited  during  the  VSTEA, 
however,  the  actual  instability  in  the  Redeye  sections  was  approximately 

>,  percent  per  year. 

(d)  In  addition  to  the  availability  of  an  MTS,  the  Reserve  Components  (QL3) 
require  additional  TriTs  to  provide  greater  availability  to  Redeye  sections 
(current  issue  is  approximately  one  THT  per  state  National  Guard 

e  rganization) . 

9.  Additional  research  related  to  MOS  16P,  Short  Range  Air  Defense 
Missile  crewmen,  wus  conducted  by  Army  Research  Institute,  concerning 
e  aparrai  skill  retention,  as  part  of  their  1978  work  program.  The 
researh  was  performed  to  determine  if  Chaparral  crewmen  were  able  to 
C.r.onst  rate  job  proficiency  upon  arrival  at  their  units,  and  if  not  to 
determine  the  causative  factors. 

(a)  The  test  was  conducted  to  evaluate  the  retention  of  Chaparral 
jxiiis  between  training  .>nd  utilization  on  the  job,  to  determine  the  most 
effective  schedule  of  refresher  training,  and  to  develop  data  on  for¬ 
getting  over  time  for  task  performed.  The  study  involved  training 
personnel  in  the  unit  to  100  percent  criteria  by  use  of  job  aids  on  six 
tusks.  The  air  defense  crewmen  were  then  tested  at  1,  2,  and  4  month 
intervals  to  determine  performance  decay.  Key  features  of  the  Cha parrel 
'•'■'ill  retention  program  included: 

1)  Prepackaged  evaluation  tools. 

(2)  Prepackaged  performance-oriented  training  materials. 

(3)  Training  of  squad  leaders  In  performance-oriented  evaluation. 

(4)  Training  assistance  visits  by  personnel  qualified  in  per f u ra:m e- 
-ri.'nted  training  and  In  the  Chaparral  system. 

(3)  orientation  of  battalion  commanders. 

lb)  The  sample  size  and  summary  of  results  were  as  follows: 

v  i )  A  total  >f  rib  personnel  completed  the  testing  program. 


(2)  The  following  significant  findings  were  reported  by  ARI: 

a  Performance  on  skills  tested  does  not  decay  during  the  period  from 
graduation  until  personnel  report  to  the  unit. 

b  Performance  to  standard  on  tasks  which  have  job  aids  remains  stable 
over  at  least  a  A  month  retention  interval. 

c  Semi-annual  refresher  training  may  be  sufficient  for  the  six  tasks 
tested . 

(3)  Significant  Army  Training  Study  findings: 

a_  The  results  of  this  study  provide  significant  support  t  the 
concept  of  job  performance  aids  being  developed. 

_b  To  be  useful,  job  aids  must  be  available  at  the  equipment  and  their 
use  must  be  enforced. 

10.  Summary  of  .ARTS  conclusions.  Anal  vs  is  of  the  re;  rt  data  base 
and  participant  soldier  comments  reveals  information  in  the  following 
areas: 

(a)  Instability.  Instability  with  Redeye  sections  is  presently  about  (QLA) 
bo  percent  per  year  in  long  tour  areas  and  100  percent  per  year  in  short 
tout  areas.  This  instability  has  a  significant  effect  as  new  personnel 
rust  be  almost  constantly  retained.  Although  not  a  direct  finding  of  this 
study,  observations  of  Redeye  sections  inicate  that  the  combat  effective¬ 
ness  of  any  particular  Redeye  section  would  be  increased  if  an  NCO  and  'or 
: finer  is  actually  assigned  to  the  section. 

C  b)  soldier  quality. 

f.i)  Attitudinal  data  indicate  soldier  dissatisfaction  with  treatment  ( QL  2 ) 
in  their  units  m  that  they  are  not  properly  used  as  Redeye  gunners. 

■•tinners  reel  they  do  not  receive  enough  "hands-on"  equipment  training  in 
• 1  e  r  the  MTS  or  during  field  exercises.  This  data,  plus  the  survey 
tinui,'it,s  concerning  intent  to  reenlist,  support  a  possible  relationship 
bet  o  c-n  gaud  training,  job  satisfaction  and  reenlistment.  This  may  also 
indicate  the  importance  of  training  leaders  to  employ  the  Redeye  systems 
.  r  p  u  r  1  y  . 

i.  2 )  Survey  fincings  showed  that  b5  percent  of  the  Redeye  gunners  (QL2) 

i  :i'uted  their  chances  of  reenlisting  were  less  than  50  percent.  In 
addition,  almost  5u  percent  indicated  that  they  will  probably  not  make  the 
Army  a  career. 

(,  i  ;  With  respect  to  trainability  by  mental  category,  the  Redeye  ( 2JL  3 ) 

:  .dies  demonstrate  that  all  mental  categories  were  trained  to  an 
>  ■  e;. table  level  of  proficiency  on  the  MTS  in  the  alloted  time  in  the 
i m-t i tut  ion.  The  proficiency  of  personnel  in  lower  mental  categories. 


■  .  '  t;-  :  >•:  »:*‘S  t  he  :  ;r  -.ore  t  ft- quo:'  t  training  for  selected 

...... ; .  ,1>  it  ;  r  :  i  '  ie.;c  y  i  ,  t.>  be  .  a  in  t.i  i:ied  . 


(c)  Kquipr.er. t . 

(1)  As  already  stated,  the  Stinger  system  (follow-on  to  Redeye)  has  a  (QL4) 
complex  kRP  and  LR  tone  system  as  well  as  an  IFF  capability.  If  the 
existing  system,  Redeye,  is  already  so  complex  that  many  assigned 
personnel  ace  unable  to  operate  it  at  its  design  Ph ,  then  it  is  reasonable 
to  assume  that  Stinger  will  require  a  well  designed  supportive  training 
package.  Ihis  package  should  oe  developed  in  parallel  with  the  weapons 
system.  A  Training  effectiveness  Analysis  is  clearly  warranted. 


B  —  1  —  1 0 


(2)  One  of  the  critical  training  implications  of  the  Stinger  .system 
is  how  to  handle  the  complex  range  ring  profile  and  the  1/6  range  ring 
coverage  requirement  for  system  activation.  According  to  the  results  of 
this  study,  a  system  may  have  been  developed  which  is  very  difficult  to 
train. 

(3)  As  shown  in  the  REDEYE  study  the  Mean  Ph  achieved  by  gunners  in 
the  institution  and  unit  on  the  MTS  was:  (Note:  For  study  purposes 
unclassified  Redeye  System  design  Ph  of  .85  was  used). 

Redeye  Institution  Ph  =  .75 

Redeye  Unit  Ph  =  .73 
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series  of  computer  simulations  using  the  COMO  III  model  conducted 
the  mid-1980  European  scenario  modified  for  the  study  based  upon  the 
r  raid  expected  over  a  division  size  ground  force.  The  purpose  of 
simulations  was  to  evaluate  the  effect  of  Redeye  proficiency  in 
of  Red  kills  as  a  function  of  proficiency.  In  these  simulations  the 
iency  was  varied  from  0.1  to  1.0  probability  of  hit  in  increments  of 
Ten  (10)  Monte  Carlo  runs  were  made  for  each  increment  of  profi- 
from  .1  to  1.0.  Results  indicate  that  kills  of  RED  aircraft 
se  in  relation  to  increases  in  Redeye  gunner  proficiency  as  shown 


24  Redeye  Teams 
86  Aircraft  Small  Scenario 
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The  small  scenario  consisted  of  86  aircraft  and  24  REDEYE  teams.  As 
the  proficiency  increased  from  0.1  to  1.0  the  RED  kills  increased  from  5.4 
to  40.2.  With  input  of  the  mean  Ph  values  from  institution  and  units  the 
results  varied  from  31.6  to  30.7  kills,  respectively.  System  design  Ph 
input  results  in  RED  aircraft  losses  of  34.0.  Therefore,  current  unit 
combat  effectiveness,  as  measured  by  gunner  performance  on  the  MTS  are 
appropriate  10  percent  below  design. 

A  second  series  of  computer  simulations  were  conducted  which  included 
I -HAWK  and  ROLAND  air  defense  systems.  The  purpose  of  this  large  scenario 
was  to  evaluate  the  contribution  of  REDEYE  when  displayed  with  other 
systems.  The  REDEYE  gunner  proficiency  was  varied  as  before  for  ten  (10) 
Monte  Carlo  runs  for  each  increment  of  proficiency.  Analysis  of  results 
showed  the  number  of  RED-aircraft  killed  increased  as  a  function  of  REDEYE 
gunner  proficiency  from  a  low  of  2.1  aircraft  with  .1  Ph  to  16.7  aircraft 
with  1.0  Ph .  Results  of  the  large  scenario  are  displayed  below. 


Figure  9.  Aircraft  Powned  versus  Redeye  Proficiency  (QI  3) 


If  Che  Ph  values  for  the  institution  and  unit  are  compared  to  system 
design  probability  of  hit  (Ph)  the  results  vary  between  13.3,  12.7,  and 
15.6  aircraft  kills,  respectively.  Again,  current  levels  of  Redeye  gunner 
combat  effectiveness  are  computed  at  approximately  10  percent  below  design 
capabilities . 

Care  must  be  taken  in  analyzing  the  results  of  these  simulations  and 
comparing  them  to  actual  field  conditions  because  they  do  not  include 
actual  average  gunner  reaction  times  or  range  estimations  since  gunner 
proficiency  was  measured  on  the  MTS  as  opposed  to  actual  firing.  In  lieu 
of  these  values,  fixed  values  were  taken  from  a  previous  study  and 
modified  to  reflect  errors  from  the  range  ring  profile  test  given  to  all 
gunners  surveyed. 

Based  upon  a  comparison  of  the  results  the  following  conclusions  are 
d  rawn : 

There  is  a  correlation  between  Redeye  gunner  proficiency  (as 
measured  by  MTS  Ph)  and  aircraft  kills  in  which  aircraft  kills  increase  as 
gunner  proficiency  increases. 

b_  Minor  improvement  can  be  made  in  both  institutional  and  unit 
training  programs  so  that  Redey  gunners  perform  at  a  proficiency  closer  to 
system  design  capabilities. 

£  It  would  appear  that  unit  programs  require  further  study  to 
determine  corrective  actions  required  to  eliminate  or  reduce  the  decay 
which  occurs  in  Redeye  gunners  following  graduation  from  AIT. 

(4)  The  use  of  higher  resolution  war  models  which  allow  variation  in  (QL3) 
values  assigned  to  individual  steps  in  the  engagement  sequence  will  allow 
more  accurate  determination  of  the  relationships  between  those  steps  and 
decreased  proficiency.  Tied  to  these  higher  resolution  war  models  is  the 
need  for  increased  instrumentation  of  the  MTS  to  record  the  time  at  which 
a  gunner  performs  each  step  in  the  engagement  sequence. 
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Proficiency  Development  Profiles  for  MOS  63C/H 

a.  Test  status.  As  of  13  July  1978  both  Active  Army  and  National 
Guard  material  was  received. 

b.  Responsible  agencies.  US  Army  Ordnance  and  Chemical  Center  and 
Sc  hool . 

c.  Test  synopsis.  This  test  was  designed  to  determine  proficiency 
development  profiles  for  63C,  track  vehicle  mechanic  and  63H,  tank 
automotive  repairman,  as  a  function  of  months  in  MOS,  aptitude  scores  and 
rank  and  for  various  types  of  advanced  individual  training  (AIT)  programs. 
Soldiers  tested  were  assigned  to  CONUS  and  USAREUR  based  active  Army 
divisions  and  one  National  Guard  division.  Soldiers  tested  were  in  grades 
E1-E7.  Data  were  collected  using  hands-on  examinations  and  question¬ 
naires.  Tests  used  in  the  hands-on  portion  were  selected  to  sample  a 
broad  spectrum  of  maintenance  capabilities  in  the  areas  of  remove  and 
replace,  align  and  adjust,  and  troubleshoot.  Two  performance  tests  were 
developed.  The  first  evaluated  63C  personnel  grades  E1-E6  and  consisted 
of  eight  tasks.  A  second  eight  task  test  was  designed  to  evaluate  63H 
soldiers,  grades  EL-E5.  Two  troubleshooting  tasks  included  in  this  test 
were  not  skill  level  one  tasks  for  63H  personnel.  Although  not  taught  in 
the  b3HU  resident  course,  these  two  tasks  were  included  to  gather  infor¬ 
mation  concerning  the  degree  to  which  the  critical  skill  of  trouble¬ 
shooting  is  learned  in  the  63H  maintenance  environment.  To  collect 
additional  troubleshooting  data,  a  test  consisting  of  four  troubleshooting 
tasks  was  designed  and  given  to  63H  personnel,  grades  E6-E7.  Common 
military  vehicles  such  as  the  M151A1  and  M60A1  were  used  for  the  testing. 
The  tests  were  standard,  and  no  attempt  was  made  to  restrict  tasks  to 
those  performed  by  an  individual  MOS  holder. 

Additional  data  was  gathered  by  use  of  questionnaires  completed  by 
both  those  soldiers  tested  and  by  their  supervisors.  Individual  aptitude 
area  scores  and  general  ability  information  was  obtained  from  MILPERCEN. 

As  the  data  was  collected,  it  was  coded  and  placed  in  a  computerized 
data  base.  Summary  reports,  which  were  analyzed  for  possible  errors,  were 
generated  as  data  was  added. 

d.  Description  of  subtests.  None 

e.  Sample  sizes:  Table  One 
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(c)  Operational  availability  would  be  reduced  severely  if  availa¬ 
bility  depended  primarily  on  indvidual  diagnostic  and  repair  proficiency. 
By  using  extraordinary  management  practices,  such  as  over  specialization 
of  personnel  and  heavy  reliance  on  replacement  rather  than  repair,  com¬ 
manders  and  supervisors  are  curren'ly  able  to  maintain  adequate  equipment 
availability.  If  supply  conditions  were  to  change  such  that  replacement 
components  were  not  as  fully  available  as  they  are  currently  (e.g., 
wartime  conditions),  these  extraordinary  management  practices  might  fail 
with  the  potential  result  being  a  dramatic  drop  in  equipment  availability. 
The  need  for  extraordinary  management  practices  would  lessen  if  systematic 
efforts  were  made  in  the  field  to  increase  the  proficiency  of  maintenance 
personnel.  Such  efforts  were  not  observed  during  the  conduct  of  the 

test . 

(d)  The  concept  of  training  and  development  maintenance  personnel  on 
a  broad  spectrum  MOS  basis  as  opposed  to  specific  job  or  duty  position 
requirements  needs  reevaluation  at  least  until  there  are  effective  field 
sustainment  training  programs. 

(e)  National  Guard  personnel  in  MOS  63C  and  63H  of  the  one  unit 
visited  performed  at  a  generally  lower  level  that  their  active  Army 
counterparts  on  a  broad  spectrum  of  MOS  tasks. 
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This  generalization  did  not  hold  true  for  performance  on  the  tank 
troubleshooting  test  administered  to  senior  63H  soldiers.  Mean 
performance  levels  though  very  low  (less  than  2  correct  with  prompting) , 
are  about  equal,  however,  the  National  Guard  sample  size  was  small  (n=8). 


Figure  e.  Comparison  of  Mean  Perferrar.ee  Level  s  ;•  e  twur  National 
Guard  and  Active  I'uty  63H  Personnel  r  th<.  Pour  Task 
Troui ieshoct ing  Test  for  the  Zero  Prompting  Corditicn 
(No  Supervision)  (QL4) 

based  upon  the  limited  sample,  the  concept  of  training  and  developing 
National  Guard  maintenance  personnel  on  a  broad  spectrum  MOS  basis  should 
be  reviewed  in  light  of  the  inadequacies  of  unit  training.  Mobilization 
training  for  63C  and  63H  soldiers  should  not  be  broad  spectrum,  but  should 
be  targeted  at  those  tasks  to  be  performed  during  activation.  A  differen¬ 
tiated  training  approach  could  not  only  do  such  targeting,  but  it  could 
also  take  advantage  of  any  prior  mechanical  experience  of  the  soldiers 
mobilized.  Correlation  between  the  various  predictor  variables  and  test 
performances  Indicates  a  strong  link  among  relevant  training  and 
experience  . ad  proficiency  levels.  While  aptitude  scores  were  not 
available  for  National  Guard  personnel,  the  relation  between  education  and 
performance  for  63H  personnel  indicates  that  ability  is  also  an  essential 
ingred ient . 

6.  Arts  Comments  and  Conclusions. 

(a)  While  the  difference  in  the  average  number  of  tasks  completed  (QL4 ) 

correctly  by  higher  and  lower  aptitude  indivduals  is  measurable,  both 
groups  scored  very  low.  Mechanical  maintenance  (MM)  aptitude  scores  can 
be  used  to  predict  proficiency  over  time.  Although  this  data  follows  the 
classic  learning  and  retention  curves  as  a  function  of  ability,  the  spread 
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between  the  number  of  tasks  performed  «'o  r  rer  1 1  y  was  so  small  that  no 
Inference  is  made  concerning  this  aspect  ot  the  test. 

(b)  The  common  phenomenon  of  specialization  observed  in  units 
suggests  that  more  frequent  sustaining  training  is  needed.  While 
perception  in  the  field  may  be  that  the  present  AIT  curricula  is  too 
broad,  the  establishment  of  effective  field  sustainment  training  programs 
should  remedy  the  problem.  To  meet  the  immediate  needs,  the  broad  scope 
of  the  HuS  should  be  studied.  Potentially,  this  could  either  shorten  AIT 
or  allow  time  for  development  of  enhanced  proficiency  within  a  narrower 
spectrum  of  skills.  Further,  It  reduces  the  scope  of  OJT  programs.  In 
the  final  analysis,  actual  job  needs  should  determine  the  training  base 
produc  t . 

(o)  A  significant  number  of  tasks  taught  to  one-time  proficiency  (oLA) 

during  AIT  appear  to  decay  before  graduation.  This  suggests  that  the 
dSAOCCS  should  establish  internal  procedures  to  refresh  those  tasks  during 
Ail  so  as  to  ensure  that  competence  Is  still  present  at  graduation.  It  is 
assumed  that  the  retraining  time  would  be  considerably  less  than  initial 
training  time,  hence,  this  does  not  necessarily  imply  significant  changes 
in  course  lengths. 

(d)  The  procedural  nature  of  maintenance  tasks,  the  manifest  symptoms  (QLA) 
of  inaccurate  performance  (incorrect  diagnosis,  incorrect  repair)  and  the 

high  cost  of  alternative  train-up  strategies,  appear  to  make  this 
performance  problem  a  prime  candidate  for  the  application  of  job  aid 
technology  and  on-slte  TEC  as  an  exported  job  training  package.  However, 
tl'.e  o3C/ri  SWT  observed  broad-scale  disinclination  to  use  existing 
technical  manuals,  even  when  such  use  was  encouraged  during  this  test.  It 
can  be  hypothesized  that  this  reflects  target  population  reading  problems, 
inadequacy  of  existing  TMs ,  and  negative  peer  pressures.  In  any  event, 
the  precise  causes  of  the  present  disinclination  should  be  Identified  and 
neutralized  or  accommodated  before  implementation  of  a  job-aid/TEC 
solution.  The  lack  of  viable  OJT  programs  suggests  that  units  lack  either 
the  resources  or  expertise  (or  both)  to  prepare  and  conduct  such  programs. 

In  consonance  with  TRADOC  philosophy,  the  proponent  school  has  the 
obligation  to  design  and  develop  training  packages  to  fill  this  void. 

This  problem  suggests  that  on-site  Introduction  of  exportable  training 
packages  may  be  essential  to  ensure  that  they  are  used  as  designed. 

(e)  The  level  of  competence  exhibited  by  supervisors  is  so  unsatis-  (Q14) 
factory  that  it  suggests  immediate  remedial  action.  Specifically  broad 

scale  diagnostic,  testing  could  be  accomplished  to  determine  if  the  sample 
tests  were  true  Indicators  of  supervisor  competence.  If  they  prove  to  be 
truly  indicative,  USAOCCS  should  consider  establishing  immediate  programs, 
perhaps  using  mobile  training  teams  and  self-study  job  training  packages 
to  upgrade  unit  maintenance  supervisors.  Until  supervisors  achieve  some 
minimum  level  of  competence,  it  may  be  inappropriate  to  administer  SQT  2 
to  skill,  level  1  personnel. 
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(t)  Some  maintenance  problems  are  so  evident  they  can  neither  be 
unnoticed  nor  misinterpreted.  For  example,  the  conduct  of  the  Tank  Crew 
Turbulence  Test  was  interrupted  due  to  numerous  equipment  breakdowns. 

ARTS  on-site  observers  reported  some  tank  crewmen  could  not  perform  simple 
maintenance  tasks.  Thus,  there  may  be  a  parallel  lack  of  competence  in 
operator  maintenance.  It  may  be  that  parallel  efforts  are  needed  in  order 
to  upgrade  maintenance  management  and  proficiency. 

(g)  Data  gathered  from  testing  conducted  at  one  National  Guard  unit  ( QL 4 ) 

supports  the  same  conclusions  as  those  drawn  from  the  data  gathered  from 
active  duty  units. 


Cost  effectivenes  of  Institutional  and  Unit  Training  Programs  for  MOS  63C 
and  63H 


a.  Test  status.  This  test  is  complete. 

b.  Responsible  agency.  US  Army  Ordnance  and  Chemical  Center  and 
School . 

* 

c.  Synopsis  of  study.  Study  objectives  were  to  identify  proficiency 
levels  assoc 'ated  with  various  resident  and  OJT  programs  and  to  identify 
the  costs  and  an-icipated  proficiency  levels  for  various  combinations  of 
these  programs.  Data  were  collected  on  cost  and  effectiveness  of  four 
basic  approaches  to  resident  instruction  as  follows: 

(1)  Broad  spectrum  initial  training  via  conventional  approach  to 
skill  level  2. 

(2)  Initial  conventional  training  to  skill  level  1. 

(3)  Initial  self-paced  training  to  skill  level  1. 

(4)  Training  to  a  higher  standard  during  AIT. 

Training  costs  were  also  investigated  for  low  and  high  mental  aptitude 
groups  and  individuals  with  different  levels  of  preservice  experience. 
Field  data  were  collected  using  the  hands-on  examinations  and  question¬ 
naires  described  in  the  Proficiency  Development  Profiles  Test. 

Information  on  mental  ability,  AFQT  and  mechanical  maintenance  (MM)  was 
obtained  from  historical  records  of  recent  AIT  graduates.  Aptitude  and 
experience  data  was  used  in  conjunction  with  course  completion  times  to 
determine  differences  in  time  to  complete  the  self-paced  AIT  course.  Cost 
data  for  the  institutional  training  program  were  obtained  from 
Headquarters,  TRADOC. 

d.  Description  of  subtests:  None. 

e.  Sample  size. 


Category 


Sample  Size 


AFQT  Score 

less  than  46  (CAT  III  B  +  IV) 

46-62  (CAT  III  A) 

greater  than  63  (CAT  I  and  II) 
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90-100 


142 


101-110 
111  + 


124 

95 

22 

32 

73 

24 

54 


(a)  Conclusions  from  this  study  build  on  the  conclusions  reached  in  (QL4) 
the  Proficiency  Profiles  Test  and  should  be  read  in  conjunction  with  the 
conclusions  from  that  test.  The  only  OJT  program  discovered  was  one 
designated  to  have  the  novice  work  with  a  more  experienced  soldier.  In 
this  case,  the  novice  was  being  trained  to  perform  presently  assigned 
tasks.  No  OJT  program  geared  toward  the  broad  spectrum  of  the  63C  or  63H 
MOS  was  found.  Due  to  lack  of  a  systematic  unit  training  program,  cost 
data  was  restricted  to  institutional  training.  Institutional  training  can 
be  effective  in  developing  broad  spectrum  maintenance  capabilities  in  a 
relatively  short  period  of  time.  While  the  mode  of  training,  conventional 
or  self-paced,  does  not  seem  to  affect  either  the  initial  level  of 
learning  or  the  retention  level,  self-pacing  usually  results  in  a  training 
time  savings  and  is  thus  the  most  cost-effective.  For  the  63H,  for 
example,  the  savings  was  over  $3,000  per  graduate.  In  analyzing  the  time 
taken  to  complete  the  self-paced  course,  while  AFQT  does  not  seem  to  be  a 
discrminator ,  mechanical  maintenance  (MM)  can,  perhaps,  be  used. 

«  Considering  the  63H10  course,  it  costs  $6,346  to  train  those  in  the  MM 
90-100  group  (a  minimum  score  of  90  is  required  to  enter  the  course); 

$6,021  for  the  101-110  group;  and  $5,695  for  the  greater  than  110  group. 

The  difference,  about  $750,  indicates  that  selection  of  higher  ability 
soldiers  by  MM  scores  could  reduce  training  costs  by  about  12  percent. 
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(b)  Prior  experience  also  seems  to  influence  training  time.  One  or  (QL4) 
more  years  of  garage  experience,  vocational/ technical  school  automotive 
training,  and  hobby  experience  reduce  initial  training  time  in  the  63H 
course  while  having  high  school  automotive  training  does  not  seem  to 
result  in  any  reduction  of  training  time  over  the  no  experience  group.  A 
soldier  with  1  or  more  years  on  the  job  as  a  mechanic  can  be  trained  for 
about  $750  less  than  the  soldier  with  no  prior  automotive  experience. 
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School  Auto 
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Figure  8.  Comparison  of  63H10  Self-Paced  Course  Completion 
Time  with  Prior  Experience  (QL4) 
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Proficiency  developed  during  AIT  decays  very  rapidly  if  not  reinforced  on 
the  job.  Available  data  indicates  that  performing  remove/replace  tasks 
and  mechanical  adjustments  about  once  a  year  appears  to  produce  a  • 
reasonable  capability  to  perform  with  moderate  supervision.  A  comparable 
capability  for  mechanical  troubleshooting  would  require  performance  once 
evey  three  to  four  months.  The  capability  to  perform  electrical 
troubleshooting  tasks  with  moderate  supervision  would  require  performance 
more  frequently  than  once  each  4  months.  Attaining  and  maintaining  the 
capability  to  perform  without  supervision  or  assistance  would  require  a 
higher  frequency  of  reinforcement. 

2.  ARTS  Comments  and  Conclusions. 

(a)  ARTS  comments  and  conclusions  for  the  Proficiency  Profiles  Test 
should  be  read  in  conjunction  with  those  expressed  below. 

(b)  Mechanical  Maintenance  (MM)  scores  and  preservice  experience  have  (QL4) 
been  shown  to  be  discriminators  in  training  time  for  the  63H  course.  The 
personnel  system  currently  uses  MM  as  a  prerequisite  for  entrance  into  the 
63H10  course.  Consideration  should  be  given  to  adding  preservice 

experience  such  as  1  or  more  years  of  garage  experience,  vocational/ 
technical  school  automotive  training,  or  hobby  experience  as  another 
desired  prerequisite.  Diagnostic  testing  should  be  done  to  further 
explore  these  areas  and  determine  if  MM  and  various  experiences  are 
statistically  valid  discriminators  for  other  Ordnance  MOSs. 

(c)  While  the  preliminary  retrain  data  presented  here  is  valuable,  (QL4) 
further  diagnositc  testing  should  be  done.  Supervisors  may  not  currently 

be  skilled  enough  to  provide  adequate  supervision.  Further  testing  is 
especially  important  if  the  AIT  skill  refresher  exercises  and  exported  job 
training  packages  are  implemented. 

(d)  Perhaps  some  tasks,  (i.e.,  electrical  troubleshooting),  are  (QL4) 

performed  so  seldom  that  they  should  not  be  taught  in  the  institution. 

Instead,  a  job  aid  could  be  proposed  for  those  mechanics  who  must  do  this 

type  of  task. 


m 
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Identify  Optimum  Distribution  of  Individual  Training  Between  Institution 
and  Unit. 

a.  Test  status.  Test  is  final. 

b.  Responsible  agency.  US  Army  Ordnance  and  Chemical  Center  and 
School . 

c.  Synopsis  of  test:  None. 

d.  Description  of  substests:  None. 

e.  Sample  size:  None. 

f.  Summary  of  results,  findings  and  conclusions. 

1.  Summary  of  USAOCCS  findings.  Since  systematic  OJT  programs  were 
not  found  in  field  units,  it  was  not  possible  to  determine  which  tasks 
could  be  best  taught  in  the  field.  Some  insights,  however,  were 
obtained : 

(a)  Proficiency  developed  during  AIT  decays  very  rapidly  if  not  ( QL 3 ) 

reinforced . 

(b)  Troubleshooting  tasks  must  be  performed  more  often  than  remove/ 
replace  tasks  and  machanical  adjustments  if  proficiency  is  to  be 
maintained . 

(c)  The  most  cost  effective  institutional  training  is  training  on  (QL4) 
those  tasks  that  will  be  reinforced  on-the-job  at  the  appropriate 

interval . 
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Determinations  for  Training  Selected  Personnel  for  Mobilization 

a.  Test  status.  This  test  is  complete. 

b.  Responsible  agency.  US  Army  Ordnance  and  Chemical  Center  and 
School . 

c.  Synopsis  of  study.  Data  gathered  in  other  USAOCCS  tests  and 
studies  were  added  to  information  concerning  the  number  of  individuals 
completing  automotive  training  programs  in  1975-1976  and  to  data  on  the 
certification  of  automotive  mechanics  by  the  National  Institute  for 
Automotive  Service  Excellence  (NIASE)  to  get  insights  concerning  the  pool 
of  trained  and  experienced  mechanics  under  the  age  of  30  years  which 
exists  in  the  civilian  labor  market. 

d.  Description  of  subtests:  None. 

e.  Sample  size:  Not  applicable. 

f.  Summary  of  results,  findings,  and  conclusions. 

1.  Summary  of  USAOCCS  conclusions.  Community  colleges  and  trade  (QL4) 

schools  graduate  over  50,000  students  from  their  automotive  programs  each 
year.  The  NIASE  certifies  approximately  20,000  mechanics  under  30  years 

old,  annually  in  one  or  more  automotive  areas.  Currently  there  are  about 
65,000  certified  individuals  in  the  under  30  age  group  and  approximately 
10,000  of  these  are  certified  as  general  automotive  mechanics.  Such  prior 
training  and  experience  should  reduce  training  time  by  15-50  percent  over 
that  of  nonexper ienced  individuals  if  self-paced  instruction  is  used  to 
capitalize  on  individual  differences. 

2.  ARTS  comments  and  conclusions.  Further  study  should  be  done  to  (QL4) 
see  if  similar  pools  of  talent  exist  in  other  areas.  For  example,  the  ham 
radio  operator  might  be  trained  as  a  military  communicator.  Perhaps  some 

of  these  highly  skilled  individuals  could  be  quickly  trained,  using 
exportable  training  packages.  They  could  be  used  as  trained  replacements 
relatively  rapidly  after  mobilization.  If  pools  of  skilled  civilians  are 
to  be  relied  upon  for  mobilization  purposes,  the  civilians  must  be 
locatable.  Some  sort  of  accurate  address  file  must  be  maintained.  A 
study  should  be  done  to  see  if  such  addresses  are  being  kept  on  files  by 
civilian  associations. 
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Compare  Task  Performance  of  Self-Paced  Graduates  (05C/F) 


PROFICIENCY 

EXAMINATION 


DEMOGRAPHIC 

DATA  1 

COMPARED  WITH 

ATTITUDINAL 

DATA  J 

DEMONSTRATED 

PROFICIENCY 

a.  Test  status.  As  of  12  July  1978,  no  additional  data  reduction  is 
contemplated.  However,  additonal  data  analysis  is  to  be  accomplished 
during  TEA  '79. 

b.  Responsible  agencies.  The  test  plan  was  developed  by  the  05C/F 
System  Work.  Team  (SWT)  of  the  US  Array  Signal  Center  and  Ft.  Gordon 
(U'SASC&FG).  This  test  was  conducted  in  direct  support  of  the  Array 
Training  Study  to  explore  a  pacing  MOS  from  the  combat  support  area. 

c.  Synopsis  of  test.  The  objective  of  this  test  was  to  evaluate  the 
effectiveness  and  efficiency  of  the  05C  program.  Existing  proficiency 
tests  were  used  to  gather  data  on  group-paced  and  self-paced  students. 
Demographic  data  was  gathered  from  course  records.  Student  attitudinal 
data  were  gathered  using  an  end-of-cour se  critique.  Instructor  and 
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supervisory  attitudes  toward  the  05C  self-paced  and  group-paced  courses 
were  gathered  using  a  questionnaire  developed  for  each. 

* 

d.  Description  of  subtests.  None. 

r 

e.  Sample  size.  Fifty  MOS  05B  radio  operators  and  144  05F  radio 
teletypewriter  operators  (non-Morse)  who  have  been  trained  in  the 
group-paced  mode  of  instruction  were  utilized  as  the  control  group  for 
purposes  of  providing  baseline  data  for  comparison.  Thirty  MOS  05C  radio 
teletypewriter  operators  who  have  been  trained  in  the  self-paced  mode  of 
instruction  were  used  as  the  experimental  group  in  the  study.  Eight  tasks 
were  identified  for  data  collection  and  comparison.  All  eight  tasks  were 
shared  by  two  or  more  of  the  MOSs .  Three  tasks  were  commonly  shared  by 
all  three  MOSs. 

f.  Summary  of  results,  findings,  and  conclusions. 

1.  USASC&FC  findings  are  that  the  graduates  of  the  self-paced  05C 
experimental  group  and  the  05B  and  05F  control  group  performed  equally 
well  on  the  common  tasks.  Initial  average  course  completion  time  for  the 
05C  self-paced  course  was  higher  than  the  05C  group-paced  course.  As  the 
course  stabilized,  however,  average  completion  time  decreased.  Admini¬ 
strative  procedures  were  Identified  as  the  probable  cause  for  increased 
self-paced  course  completion  time.  Additionally,  training  holidays  during 
the  test  period  were  alluded  to  as  having  been  a  factor  in  an  earlier 
increased  course  length.  A  further  causal  factor  may  have  been  a  lack  of 
instructor  training  prior  to  the  conduct  of  the  self-paced  course. 

2.  Similarly,  the  attrition  of  the  05C  self-paced  course  increased  ( QL, 4 ) 

significantly  immediately  following  implementation.  When  compared  over 

the  long  term,  however,  the  attrition  of  the  05C  self-paced  course  was 
comparable  to  that  experienced  in  the  group-paced  courses.  The  instructor 
and  supervisor  survey  data  indicated  that  the  05C  self-  paced  course  pro¬ 
duced  a  better  graduate.  The  cost  per  graduate  decreased  for  the  self- 
-paced  05C  course.  In  summary,  USAC&FG  concluded  that  the  05C  self-paced 
course  produces  an  equally  proficient  graduate  with  approximately  the  same 
rate  of  attrition  in  slightly  less  time  and  at  slightly  reduced  cost. 
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Test  Proficiency  of  05C/F  Teams  in  Field  Units 

a.  Test  status.  As  of  12  July  1978,  further  data  reduction  and 
analysis  are  scheduled.  Final  report  is  due  September,  1978. 

b.  Responsible  agencies.  The  test  plan  was  developed  by  the  05C/F 
System  Work  Team  (SWT)  of  the  US  Army  Signal  Center  and  Ft.  Gordon 

( USAASC&FG) .  This  test  was  conducted  in  direct  support  of  the  Army 
Training  Study  to  explore  a  pacing  MOS  from  the  combat  support  area. 

c.  Test  synopsis.  This  test  was  designed  to  collect  information  in 
the  following  areas: 

(1)  Method  and  location  of  training  for  obtaining  the  MOS  05C. 

(2)  Demographic  data. 

(3)  Attitude  factors. 

(4)  Job  holder  profiles. 

This  study  compared  proficiency  of  05C  graduates  of  self-paced  versus 
group-paced  institutional  training,  and  institutional  training  versus 
unit  OJT.  Proficiency  was  measured  with  a  test  consiting  of  a  66  item 
hands-on  component  and  44  written  items  requiring  practical  performance  in 
the  written  mode. 

d.  Number  of  Subtests.  None. 

e.  Sample  size.  The  test  sample  consisted  of  276  05C  team  members 
and  supervisors  from  three  active  CONUS  Infantry  divisions,  one  Mechanized 
Infantry  roundout  bridgade,  and  one  National  Guard  Armored  divison.  Due 
to  time  constraints  and/or  computer  identification  data,  a  test  sample  of 
134  was  usable  out  of  the  original  population. 

f.  Summary  of  results,  findings,  and  conclusion. 

1.  USASC&FC  findings  were  that  the  05C  job  holders  who  had  completed 
group-paced  training  performed  better  on  two  or  three  written  components 
of  the  test  (radiotelephone  and  rat io te le type  writer  processing).  Conver¬ 
sely,  the  03C  job  holders  who  had  completed  self-paced  training  performed 
beter  on  four  of  five  hands-on  components  of  the  test.  The  latter 
difference,  however,  was  not  statistically  significant. 
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Validation  of  Anti-Armor  REALTRAIN  for  Engagement  Simulation 

a.  Test  Status:  As  of  13  July  1978  the  test  had  been  completed  and 
results  published  as  Army  Research  Institute  (ARI)  Research  Report  1191, 
"Initial  Validation  of  REALTRAIN  with  Army  Combat  Units  in  Europe h"  dated 
October  1976. 

b.  Responsible  Agencies.  The  test  plan  was  developed  by  ARI  in 
coordination  with  the  TRADOC  "REALTRAIN"  mobile  training  team  (MTT) 
implementing  the  "REALTRAIN"  program  in  USAREUR.  Data  from  the  test  are 
incorporated  in  the  ARTS  TEA  through  coordination  between  Director,  Army 
Training  Study  and  ARI. 

c.  Synopsis  of  test.  A  team  from  the  Array  Research  Institute 
accompained  the  TRADOC  MTT  implementing  the  REALTRAIN  training  method  in 
USAREUR.  Training  was  conducted  for  3  weeks  at  each  of  four  divisional 
training  areas  over  the  period  3  November  1975  to  5  March  1976.  Using 
nineteen  collection  forms,  the  research  team  gathered  data  on  the  training 
effectiveness  of  REALTRAIN,  ways  of  improving  REALTRAIN,  and  better 
methods  to  assess  unit  tactical  performance.  REALTRAIN  exercises  employ 
realistic  combat  engagement  techniques  for  simulating  weapons  effects  and 
weapons  signatures.  REALTRAIN  training  provides  for  the  learning  of 
tactical  skills  by  Armor,  Infantry,  and  Anti-Armor  personnel  in  a  combined 
arms  environment.  REALTRAIN  implementation  in  USAREUR  provided  valuable 
research  data  for  the  evaluation  of  tactical  performance  by  participants 
in  the  exercises,  "player"  and  controller  reactions  to  this  new  method, 
and  the  cost  of  conducting  such  exercises.  The  study  had  three  broad 
research  objectives: 

(1)  To  measure  the  training  effectiveness  of  the  REALTRAIN  method. 

(2)  To  identify  needs  to  refine  REALTRAIN  training  techniques. 

(3)  To  assess  the  methodology  used  for  unit  evaluation. 

Participating  players  at  each  site  were  organized  into  A  and  B  teams. 

A  teams  conducted  REALTRAIN  exercises  for  3  weeks  while  B  Teams  rotated 
every  week.  Although  many  factors  prevented  the  conduct  of  a  clear  cut 
experiment,  the  hypothesis  was  that  the  tactical  performance  of  the  A 
teams  would  improve  over  the  3  week  training  period. 

Exercises  were  of  two  basic  types:  meeting  engagements  (N  =  33)  and 
attack/defense  (delay)  (N  =  26).  The  force  ratio  was  1:1  in  all 
exercises.  An  Armor  platoon,  two  Infantry  squads,  and  a  TOW  section  were 
on  each  side.  Although  tactically  unrealistic,  the  attackers'  force 
ratio  reflects  the  primary  mission  of  the  MTT  which  was  to  maximize  cadre 
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training  effectiveness  rather  than  to  measure  REALTRAIN.  As  a  result, 
effectiveness  data  from  meeting  engagements  provide  more  reasonable 
REALTRAIN  performance  estimates  than  data  from  attack/defense  exercises. 

d.  Description  of  subtests.  None. 

e.  Sample  size. 

1.  Sample  size.  Approximately  395  cadre  personnel  were  trained  as 
controllers  with  542  Armor  and  infantry  personnel  serving  as  participants. 
A  total  of  59  exercises  were  conducted  at  four  training  sites.  A  summary 
of  the  type  exercise  by  site  is  shown  at  Table  1  below. 


Type  of  Exercise 


Meeting  Engagement 


Attack 


Total 


I  6  9  15 

II  LO  4  14 

III  9  4  13 

IV  4  (4)*  8  (1)  12  (5) 


(a)  Training  effectiveness  results  were  impressively  positive  and  (QL3) 

consistent.  A  teams  won  16  meeting  engagements;  B  teams  won  4;  13 

resulted  in  ties.  Casualty  results  show  that  in  the  third  week  across  all 
sites,  the  vehicle  casualty  ratio  (vehicles  killed/vehicles  played)  was 
0.36  for  A  teams,  0.52  for  B  teams;  and  personnel  casualty  ratios  were 
similar.  As  measured  by  a  weighted  casualty  index  (WCI),  the  performance 
difference  in  favor  of  A  teams  in  the  third  week  was  statistically 
significant.  The  difference  between  A  team  performance  for  the  first  and 
third  weeks  was  also  statistically  significant.  B  teams  showed  no  differ¬ 
ence  in  performance  between  the  first  and  third  weeks. 

(b)  Interviews  and  questionnaires  from  controllers  and  participants  (QL3) 
also  reflect  a  very  favorable,  even  enthusiastic,  attitude  toward 

REALTRAIN  effectiveness.  Participants  and  controller  trainees  alike 
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reacted  enthusiastically  to  the  REALTRA1N  program,  citing  its  realism  and 
the  learning  opportunities  in  the  combined  arras  operations,  cross-train¬ 
ing,  development  of  battlefield  confidence,  and  team  work  In  tactical 
maneuvers. 


k ; 

(c) 

• 

n 

(1) 

K 

tanks . 

y 

(2) 

y 

> 

(3) 

P 

TOWs. 

fc? 

(4) 

(c)  Overall  results  on  weapons  effects  show: 


(QL3) 


(2)  43  percent  of  the  infantry  were  killed,  mainly  by  small  arms, 


tanks . 


(d)  Table  2  presents  the  results  of  the  meeting  engagement  missions 
over  weeks  of  training.  Remembering  that  the  A  team  remained  at  each  site 
for  3  weeks  while  the  B  team  changed  each  week,  it  may  be  seen  from  the 
table  that  the  A  teams  tended  to  win  more  engagements  during  the  second, 
third,  (and  fourth)  weeks. 


(QL3) 


r  . 

-V 

v: 

Week  of 

Training 

A  Team 

Win 

B  Team 

Win 

Tie 

Total 

•w"  ' 

1 

3 

3 

4 

id 

£ 

2 

6 

0 

4 

10 

? 

3  (4) 

4  (3) 

0  (1) 

9  (4) 

r.~ 

* 

Total 

13  (16) 

3  (4) 

’3 

29  (33) 

£ 
j-  ’ 

Table  2. 

Meeting  Engagements  by  Team 

and  Week  of  Training 

B 

£ 

■V 

(e)  Training 

effectiveness 

results . 

(QL4) 


Determining  the  effectiveness  of  REALTRAIN  was  the  major  concern  of 
the  REALTRAIN  research  project.  As  explained,  performance  of  combined 
arras  teams  having  only  one  week  of  REALTRAIN  training  (team  B)  was 
compared  with  that  of  teams  having  1,  2,  and  3  weeks  of  REALTRAIN 
experience. 


The  analyses  compared  the  performance  of  teams  A  and  B  across  the  3 
weeks  of  REALTRAIN  experience.  The  five  analyses  attempt  to  isolate 
variables  discriminating  between  the  two  team  types.  Most  of  these 
attempts  were  successful.  Where  not  successful,  the  direction  of  required 
further  analyses  is  discussed. 
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(f)  Training  effectiveness  reflected  by  casualties  incurred.  The 
casualties  incurred  by  both  sides  are  the  primary  objective  data  in  a 
REALTRAIN  exercise.  When  tactical  proficiency  increases,  casualties 
should  change  in  two  ways.  A  combat  unit  should,  by  use  of  proper  cover, 
concealment,  and  movement  techniques,  decrease  the  casualties  incurred 
and,  by  more  effectively  using  its  weapons,  increase  kills  inflicted  on 
the  opposing  force. 

Results  are  shown  by  type  of  exercise — meeting  engagement  or  attack/ 
defense  (aelay)--so  that  data  trends  can  be  clearly  seen. 

(.g)  Meeting  Engagements:  Tables  3-6  show  the  percent  casualties  (QL4) 
incurred  by  team  A  and  team  B  for  each  week  of  training  for  tanks, 

Infantry,  APC,  and  TuW. 

_ Week  1 _ Week  2 _ Week  3 _ 

A  Team  48  Percent  35  Percent  36  Percent 

B  Team  45  Percent  46  Percent  67  Percent 

n=10  n=10  n=9 

Table  3.  Comparison  of  Tank  Casualties  for  Team  A  and  Team  B  Meeting 
Engagements 

Table  3  shows  that  both  teams  had  incurred  approximately  the  same 
casualties  during  the  first  week.  By  the  third  week,  however,  a 
significant  difference  is  evident  in  that  team  B  received  nearly  double 
the  casualties  of  team  A. 

Week  1  Week' 2  Week  3 

A  Team  34  Percent  40  Percent  30  Percent 

n  Team  49  Percent  36  Percent  55  Percent 

n  =  10  n  =  10  n  =  9 

Table  4.  Comparison  of  Infantry  Casualties  for  Team  A  and  Team  B  Meeting 
Engagements 

Table  4  data  demonstrates  a  similar  learning/performance  advantage 
accruing  to  "REALTRAIN"  trained  units  over  time. 

(1)  Infantry  casualties  are  not  as  clear-cut  as  tank  casualties, 
v-hile  there  was  a  demonstrable  performance  difference  during  the  third 
week  of  training  between  the  two  teams,  performance  during  the  first  two 
weeks  is  not  ‘easily  interpreted.  Two  factors  may  explain  this.  First, 

Infantry  squads  must  initially  learn  to  work  as  a  cohesive  unit,  not  as 
ir.d iv iduals :  Second,  after  learning  to  work  as  a  unit,  Infantry  must  work 
with  Armor  personnel  in  a  combined  arms  role,  learning  to  move,  shoot,  and 
co  -.tunicate  with  their  Armor  counterparts  if  the  team  is  to  be  effective. 
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Table  4  indicates  that  by  the  third  week,  the  A  teams  were  beginning  to 
get  things  "together" — reducing  the  casualties  incurred  on  themselves  and 
increasing  the  casualties  inflicted  on  the  B  teams. 
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Week  1 

Week  2 

Week  3 

A  Team 

60  Percent 

45  Percent 

35  Percent 

B  Team 

55  Percent 

65  Percent 

40  Percent 

n  =  10 

n  =  10 

n  -  9 

Table  5. 

Comparison  of  APC 
Engagements . 

Casualties  for  Team  A  and 

Team  B  Meeting 

(2_)  Table  5  indicates  that  over  the  3  weeks  of  training,  team  A's  APC 
casualties  tended  to  decrease  weekly  (60  percent  in  week  1  to  35  percent 
in  week  4).  For  team  B,  casualties  decreased  27  percent  from  week  1  to 
week  3. 


Week  1  Week  2  Week3 


A  Team 

90  Percent 

19 

Percent 

33 

Percent 

B  Team 

90  Percent 

50 

Percent 

44 

Percent 

n  =  10 

n 

=  10 

n 

=  9 

Table  6. 

Comparision  of  TOW 

Casual  ties 

for  Team  A  and 

Team  B 

Meeting 

Engagements 

(3^)  Table  6  shows  that  both  teams  lost  most  of  their  TOWs  during  the 
first  training  week.  There  was  a  very  noticeable  decrease  in  TOW 
casualties  during  the  second  and  third  weeks  of  training,  with  team  A 
showing  the  greatest  decrease. 

The  use  of  the  weighted  index  (WC1)  allows  diverse  data  categories  to  be 
integrated  into  a  single  measure.  Weightings  in  the  WCI  are  based  on 
expert  military  judgement  and  are  in  general  agreement  with  weightings  in 
other  firepower  indices.  An  area  for  important  future  research  may  be  to 
test  empirically  various  data  aggregation  indices  by  using  simulation 
techniques  such  as  REALTRAIN. 

(4)  Table  7  shows  the  average  WCI  for  team  A  attacks  and  team  B 
attacks  by  training  week.  The  top  of  the  figure  shows  that  by  Week  3, 
team  A  in  the  attack  was  able  to  reduce  combined  casualties  by  32  percent 
(from  a  WCI  of  198  in  Week  1  to  134  in  Week  3);  the  team  B  index  was 
approximately  the  same  for  weeks  1  and  3  (week  1:  119,  week  3:  117).  The 
bottom  portion  shows  that  when  Team  B  was  in  the  attack,  the  combined 
index  for  team  A  went  from  98  in  week  1  to  81  in  week  3,  a  decrease  of  17, 
while  the  team  B  casualty  index  increased  slightly  (from  160  to  171). 
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TEAM  B  ATTACKS 

Table  7.  Weighted  Casualty  Index  (QL3) 

(h)  Significant  Array  Training  Study  findings.  Analysis  of  the  research 
report  reveals  the  following: 

(a)  The  improvement  of  both  REALTRAIN  and  non-REALTRAIN  trained  teams 
reinforces  data  obtained  from  the  tank  crew  turbulence  research  which 
concluded  that  intense,  structured  training  to  specific  tasks,  conditions, 


and  standards  (modular  training)  can  result  in  improved  proficiency  over 
short  periods  of  time.  While  A  teams  (REALTRAIN)  could  be  expected  to 
demonstrate  superior  performance,  it  is  also  significant  that  B  teams 
generally  improved  relative  performance  even  in  face  of  an  Opposing  Force 
which  was  improving  at  a  greater  rate.  The  exception  to  this  is  the  tank 
blue  teams  which  did  not  seem  to  be  capable  of  offsetting  REALTRAIN 
induced  A  team  advantages. 

(b)  The  large  improvements  demonstrated  weekly  by  both  groups  are 
consistent  with  the  low  starting  proficiency  of  units  which  has  been  noted 
in  ARTS  TEA  test  results  in  both  CONUS  and  USAREUR.  Unit  training  pro¬ 
grams  are  not  training  to  the  potential  represented  by  the  personnel  and 
equipment  being  provided. 
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REALTRAIN  Validation  for  Rifle  Squads 


a.  Test  status  as  of  13  July  1978. 

1.  Validation  of  the  mission  accomplishment  Research  Report  1192  was 
published  by  the  US  Army  Research  Institute  (ARI)  in  October,  1977. 

2.  Validation  of  the  tactical  performance  draft  research  report  was 
completed  in  June  and  a  copy  was  forwarded  to  the  Director,  Army  Training 
Study  on  13  July  1978. 

b.  Responsible  agencies.  ARI,  in  coordination  with  the  US  Army 
Training  and  Doctrine  Command  (TRADOC),  has  developed  a  research  program 
to  validate  the  tactical  engagement  simulation  training  method  known  as 
REALTRAIN.  These  research  projects  were  conducted  by  ARI  and  sponsored  by 
TRADOC. 

c.  Synopsis  of  tests.  Two  tests  were  conducted  to  validate  REALTRAIN 
for  rifle  squads.  These  tests  are  hereafter  referred  to  as  Rifle  Squad  I 
(kSI)  and  Rifle  Squad  II  (KSII). 

I.  Rifle  Squad  I. 

(.a)  The  objective  of  RSI  was  to  compare  and  evaluate  the  mission 
accomplishment  and  casualty  rates  of  Infantry  rifle  squads  trained  with 
REALTRAIN  methods  and  those  of  similar  squads  which  received  conventional 
field  training. 

(b)  Procedures. 

(1)  In  phase  1,  participating  Infantry  squads  engage  in  a  pre¬ 
training  test  field  exercise  to  establish  pre-training  performance  levels. 
This  pre-training  test  included  a  movement  to  contact  and  hasty  attack 
against  a  machine  gun  outpost,  and  a  hasty  defense  against  a  skilled 
squad-sized  opposition  force. 

(2)  Phase  II  provides  3  days  of  carefully  coordinated  training  by 
REALTRAIN  methods  for  nine  squads,  and  by  conventional  methods  for  nine 

squads . 

V 3 j  Phase  III,  the  post-training  test  repeated  the  pre-training  test 
on  dirferent  terrain,  to  establish  performance  improvement  after  training. 

d.  Description  of  subtests.  Pre-training  test  and  post-training  test 
were  conducted  for  each  squad  as  outlined  in  procedures  above. 
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e.  Sample  size.  Eighteen  rifle  squads  of  nine  men  each  participated. 

Nine  squads  were  trained  with  REALTRAIN  and  nine  squads  were 
conventionally  trained. 

f.  Summary  of  results,  findings,  and  conclusions. 

I.  Summary  of  findings: 

(a)  Results  were  assessed  in  terms  of  mission  accomplishment — 
successful  attack  or  defense — and  casualties  sustained  versus  casualties 
inflicted. 

(b)  All  squad  performances  in  the  pre-training  test  were  the  same.  (QL3) 
Conventionally  trained  sqauds  did  little  better  in  post-training  test 

than  they  had  in  the  pre-training  test.  REALTRAIN  squads  did  signifi¬ 
cantly  better  on  the  post-training  test  with  regard  to  the  number  of 
successful  attacks  and  defenses.  REALTRAIN  squads  also  sustained  rela¬ 
tively  fewer  casualties,  inflicted  more  casualties,  and  took  more  time  to 
attack  than  did  the  conventionally  trained  squads.  In  the  shoot-off, 

REALTRAIN  squads  succeeded  in  accomplishing  both  attack  and  defense 
missions  more  frequently  than  did  the  conventionally  trained  squads 
opposing  them,  and  the  REALTRAIN  squads  had  more  favorable  casualty 
exchange  ratios. 

(c)  Results  from  this  portion  of  the  field  assessment  of  REALTRAIN  (QL3) 
provide  empirical  evidence,  gathered  under  a  systematic  and  comprehensive 
field  research  program,  of  the  greater  effectiveness  of  REALTRAIN  over 
conventional  combat  unit  training  for  Infantry  rifle  squads.  The  Army  is 
using  REALTRAIN  methods  now.  These  methods  will  form  the  core  of  a  total 
engagement  simulation  system  for  training  and  evaluation. 

II.  Rifle  Squad  II. 

a.  Synopsis  of  tests.  The  objective  of  RSII  was  to  compare  and 
evaluate  the  tactical  performance  of  rifle  squads  trained  with  REALTRAIN 
engagement  simulation  methods,  and  rifle  squads  trained  by  conventional 
combat  field  training  methods. 

1.  Procedure: 

(a)  In  phase  I,  participating  rifle  squads  engaged  in  a  pre-training 
test  field  exercise  to  establish  pretraining  performance  levels.  This 
pre-training  test  included  a  movement  to  contact  and  attack  against  a 
4-man  outpost,  and  a  hasty  defense  against  a  skilled  squad-sized 
opposition  force. 
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(b)  Phase  II  provided  3  days  of  carefully  coordinated  training  by 
REALTRAIN  methods  for  nine  squads,  and  by  conventional  methods  for  nine 
squads . 

(c)  Phase  III,  the  post-training  test,  repeated  the  pre-training  test 
on  different  terrain  in  order  to  establish  performance  improvement  after 
training. 

(d)  In  Phase  IV,  each  squad  conducted  two  attacks  and  two  defenses 
against  squads  of  the  other  training  group  (shoot-off  exercise). 

b.  Description  of  subtests.  A  pre-training  test  and  a  post-training 
test  were  conducted  for  each  squad  as  outlined  in  procedures  above. 

c.  Sample  size:  Eighteen  rifle  squads  of  nine  men  each  participated. 

Nine  squads  were  trained  with  REALTRAIN  and  nine  squads  were  convention¬ 
ally  trained. 

d.  Summary  of  results,  findings,  and  conclusions. 

1.  Summary  of  findings. 

(a)  Results  were  assessed  in  terms  of  mission  accomplishment, 
casualties  exchanged,  and  intermediate  tactical  performance. 

(b)  REALTRAIN  squads  showed  a  dramatic  improvement  across  a  variety  (QL3) 
of  performance  measures  following  three  days  of  tactical  training.  In 
contrast,  conventionally  trained  squads  showed  little  improvement  fol¬ 
lowing  training.  The  performance  of  REALTRAIN  and  conventional  squads 

were  similar  during  pretesting  exercises.  More  specifically,  during  post- 
training  tests,  REALTRAIN  squads  performed  better  than  conventionally 
trained  squads  during  the  attack  in  that  they: 

(1)  Accomplished  more  missions. 

(2)  Inflicted  more  casualties. 

(3)  Sustained  fewer  casualties. 

(4)  Used  cover  and  concealment  more  effectively. 

(3)  Were  more  likely  to  use  overwatch  procedures. 

(b)  Were  more  likely  to  use  suppressive  fires. 


(7)  Were  more  likely  to  employ  the  M60  machine  gun. 


(8)  Were  more  likely  to  use  the  M60  machine  gun  to  cover  the  ' 
maneuvering  element. 

(9)  Were  more  effective  in  the  use  of  hand  grenades. 

(10)  Were  more  likely  to  attack  the  defender's  more  vulnerable  flank. 

(11)  Were  more  likely  to  be  actively  controlled  by  a  leader. 

(12)  Were  more  likely  to  perform  as  an  integrated  unit. 

(c)  Similarly,  REALTRAIN  squads  performed  better  than  conventionally  (QL3) 
trained  units  during  the  defense  in  that  they: 

(1)  Accomplised  more  missions. 

(2)  Inflicted  more  casualties. 

(3)  Sustained  fewer  casualties. 

(4)  Were  more  likely  to  use  an  OP. 

(5)  Were  more  likely  to  deploy  their  more  vulnerable  flank. 

(b)  Were  more  likely  to  place  claymore  mines  to  cover  most  likely 

route  of  enemy  advance. 

(7)  Made  fewer  and  less  basic  errors  in  employment  of  claymore  mines. 

(8)  Were  more  likely  to  make  early  detections  of  the  OPFOR. 

(9)  Were  more  likely  to  open  fire  before  the  OPFOR. 

Thus,  REALTRAIN  units  showed  a  dramatic  improvement  in  tactical 
performance  during  post-training  tests,  and  they  were  far  superior  to 
conventional  squads.  In  addition,  performance  on  intermediate  tasks 
correlated  highly  with  terminal  mission  outcome. 

2.  Conclusions. 

(a)  The  results  have  shown  the  REALTRAIN  training  can  dramatically 
increase  the  tactical  proficiency  of  rifle  squads.  Increases  in  the 
quality  of  tactical  performance  occurred  across  a  broad  range  of  measures. 
Performance  on  intermediate  tasks  was  closely  related  to  mission  outcome. 

(b)  Present  rifle  squad  ARTEPs  do  not  provide  a  substantial  amount  of 
guidance  for  trainers  to  diafgnose  specific  training  deficiencies.  Table  1 
and  Figures  1  through  7  display  data  on  selected  areas  of  REALTRAIN  versus 
conventionally  trained  rifle  squads. 
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Mean  number  of  cauali.ti.e9  sustained 
by  tested  squads  in  the  attack 


Mean  number  of  casual ities 
sustained  by  test  sqauds  in 
the  hasty  defense 


Training 

Method 

Training 

Method 

RT 

CT 

RT 

CT 

Pre-training 

test 

7.9 

8.  0 

Pre-testing 
tes  t 

8.0 

7.  9 

Post-training 

test 

6.  1 

7.8 

Post-training 
tes  t 

5.  3 

7.6 

Mean  number  of  casualties 
inflicted  on  OPFOR  in  the 

attack 

Mean  number  of  casualties 
inflicted  on  OPFOR  in  the 
hasty  defense 

Training 

Me  thod 

Training 

Method 

RT 

CT 

RT 

CT 

Pre-training 

test 

.4 

.  3 

Pre-training 
tes  t 

4.4 

4.0 

Post-training 

test 

2.4 

.6 

Post-training 
tes  t 

8.  5 

4.0 

Mean  number  of  casualties  sustained  by  tested 
squads  in  shoot-off  attacks  and  defenses 

Training  Method 

RT 

CT 

Attack 

4.6 

6.  9 

De  f ense 

1.7 

2.8 

Table  1.  REALTRAIN  (RT)  vs  Conventionally  Trained  (CT ) 
Pre  and  Post-training  Comparisons 
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Figure  3.  Percentage  of  Squads  who  "Stalled  in  Place"  at 

the  Initiation  of  the  Engagement  at  the  OP  (QL3) 


TRAIN  tional  train  tional 
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Figure  4.  Evaluation  by  OPFOR  Controllers  of  Squad  Use  of  Cover/ 
Concealment  During  Attack  on  OP  (QL3) 
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Percentage  of  Squads  in  Which  One  Element  Provides 
Overwatch  for  Another  Element  During  the  OP  Engage¬ 
ment  (QL3) 
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Figure  6.  Percentage  of  Squads  Using  M60  to  Form  Base  of  Fire 
Concurrent  with  Initial  Attempts  to  Maneuver  Against 
the  OP  (QL3) 
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Figure  7.  Percentage  of  Squads  Making  an  Organized  Flanking 
Maneuver  at  the  OP  (QL3) 

3.  Summary  of  ARTS  findings.  Analysis  of  the  data  contained  in  the 
tactical  reports  reveals  the  following: 

(a)  These  research  results  support  the  findings  of  the  Tank  Crew 
Turbulence  Test  wherein  the  conduct  of  intersive  training,  narrowly 
focused  on  precise  tasks,  conditions,  and  standards,  .esults  in  an 
increase  of  individual  and  collective  proficiency  in  relatively  short 
periods.  Analysis  of  pre  and  post-training  test  casualty  comparisons 
confirms  the  progress  of  the  REALTRAIN  trained  squads.  It  is  important  to 
note  that  the  conventionally  trained  squads  also  suffered  fewer  casualties 
after  2  weeks  of  training  even  though  they  were  opposed  by  an  enemy  at 
that  time  who  was  much  more  proficient  than  during  the  pre-training  test. 

(b)  Casualties  sustained  by  all  squads  during  the  pre-training  test 
are  a  measure  of  the  low  level  of  collective  proficiency  existing  in  units 
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3.  Summary  of  ARTS  findings.  Analysis  of  the  data  contained  in  the 
tactical  reporcs  reveals  the  following: 

(a)  These  research  results  support  the  bindings  of  the  Tank  Crew 
Turbulence  Test  wherein  the  conduct  of  intersive  training,  narrowly 
focused  on  precise  tasks,  conditions,  and  standards,  results  in  an 
increase  of  individual  and  collective  proficiency  in  relatively  short 
periods.  Analysis  of  pre  and  post-training  test  casualty  comparisons 
confirms  the  progress  of  the  REALTRAIN  trained  squads.  It  is  important  to 
note  that  the  conventionally  trained  squads  also  suffered  fewer  casualties 
after  2  weeks  of  training  even  though  they  were  opposed  by  an  enemy  at 
that  trrae  who  was  much  more  proficient  than  during  the  pre-training  test. 

(b)  Casualties  sustained  by  all  squads  during  the  pre-training  test 
are  a  measure  of  the  low  level  of  collective  proficiency  existing  in  units 


Computer  Assisted  Map  Maneuver  (CAMMS ) 

a.  Status  of  test.  This  test  was  completed  during  the  period, 
February  to  June  1978.  The  draft  test  report  is  currently  being  staffed 
through  appropriate  agencies  at  the  Combined  Arms  Center  (CAC),  Ft. 
Leavenworth,  KS,  for  publication. 

b.  Responsible  agencies.  The  test  was  initiated  and  sponsored  by 
Director,  Army  Training  Study  (ARTS),  Ft.  Belvoir,  VA,  and  Commander, 
Combined  Arms  Center,  Ft.  Leavenworth,  KS. 

c.  Test  synopsis.  Tests  were  conducted  using  five  battalion  command 
groups  (two  Mechanized  Infantry  and  three  Armor).  The  battalions  were 
drawn  from  four  brigades  from  two  CONUS  divisions. 

1.  Objectives.  This  test  adressed  three  objectives.  The  first 
objective  was  to  determine  the  training  effectiveness  of  CAMMS  by  a 
determination  of  the  performance  improvement  that  could  be  derived  from  a 
computerized  battle  simulation.  The  second  objective  was  to  refine  and 
improve  the  procedures  used  to  measure  the  proficiency  level  of  battalion 
command  groups.  The  last  objective  was  to  determine  the  feasibility  of 
continuing  to  use  CAMMS  to  investigate  command-group  training. 


Pre-Test  Exercise 


Training  Exercise  Post-Test  Exercise 
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2.  Test  design. 


(a)  A  number  of  different  types  of  performance  were  measured.  The 
measurements  were  accomplished  through  a  subjective  rating  process  using  a 
pretest/posttest  design.  Command  groups  participated  in  three  separate 
exercises,  all  of  which  were  conducted  within  a  common  general  senario 
with  the  same  type  mission.  The  specific  scenarios  and  missions  were 
designed  and  assumed  to  be  of  equal  difficulty.  To  correct  any  difference 
in  difficulty,  the  missions  for  pre  and  posttest  exercises  were  counter¬ 
balanced  across  units.  A  feedback  session,  the  format  and  context  of 
which  were  being  pilot-tested  in  the  effort,  followed  each  of  the  test 

and  training  exercises.  Ideally,  a  control  group  which  received  only  the 
pre  and  posttest  should  have  been  included  to  isolate  the  performance 
gains  resulting  from  the  testing.  Add i t iona 1 ly ,  it  would  have  been 
desirable  to  use  CAMMS  only  for  the  training  session  to  avoid  spurious 
relationships  resulting  from  using  the  same  measuring  instrument  for 
testing  and  training.  Time  and  availability  of  resources  precluded 
fulfilling  these  two  conditions. 

(b)  The  computer  subsystem  was  designed  to  support  training  on 
military  and  logistics  problems,  reduce  map  maneuver  preparation  time,  and 
provide  faster  and  more  accurate  computation,  and  by  so  doing,  provide 
greater  objectivity  and  precise  summarization  of  the  events  which  occurred 
in  the  battle.  The  software  supports  the  employment  of  conventional 
forces  and  their  normal  weapons  systems.  Artillery,  air,  mortars, 
helicopters,  and  admin/log  are  processed  for  both  friendly  forces  and 
OPFOR.  Interface  with  the  computer  is  accomplished  through  four  remote 
terminals  operating  through  commercial  telephone  circuits. 

d.  Description  of  subtests:  none. 

e.  Sample  size.  Five  battalion  command  groups,  two  Mechanized 

Infantry  and  three  Armor. 

f.  Summary  of  results,  findings,  and  conclusions. 

1.  Summary  of  agency  findings. 

(a)  CAMMS  shows  evidence  of  being  an  effective  training  vehicle  for  (QLd) 
improving  battalion  command  group  proficiency  as  subjectively  judged  by 
the  consistent  and  positive  changes  in  performance  across  exercises  and 
through  differentiation  among  ARTEP  tasks,  subtasks,  and  elements  within 
exercises . 
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(b)  The  development  of  a  greater  number  of  objective  measures  of 
command  group  performance  in  CAMMS  is  feasible  to  supplement  and  supplant 
some  of  the  existing  subjective  ratings.  It  will  take  time  and  such 
objective  measures  should  not  be  expected  to  completely  eliminate 
subjective  ratings. 

(c)  The  relationship  of  command  group  performance  to  battalion 
outcomes  is  complex  and  no  single  measure  of  performance  yet  identified 
can  be  adequately  interpreted  in  isolation  from  other  measures  or  from  the 
conditions  of  the  exercise. 

(d)  Performance  of  some  ARTEP  subtasks  appears  to  influence  battle¬ 
field  outcomes.  Additional  effort  will  be  required  to  determine  the 
influence  of  other  subtasks  as  well  as  to  determine  other  useful  measures 
more  fully  reflecting  the  total  dimensions  of  battlefield  performance. 

(e)  Organizational  process  measures  did  not  discriminate  performance 
differences  among  the  various  measures  themselves  or  change  performance  as 
a  function  of  the  training  exercise,  but  their  outcome  measures  warrant 
further  investigation. 

(f)  CAMMS  has  the  potential  for  fulfilling  the  requirements  of  a 
training  research  vehicle  for  pursuit  of  TEA  '65  objectives.  Some 

mod  i  f  icat  ions  are  indicated,  but  these  are  relatively  modest  and  generally 
concern  improvements  which  would  occur  in  the  normal  CAMMS  evolution. 


2.  Summary  of  ARTS  findings. 

(a)  While  Che  small  sample  size  used  in  Che  CAMMS  TEA  CesCing  should 
be  noCed,  Chere  are  useful  insighcs  Co  be  drawn  from  Che  sCudy.  The 
limiced  sample  size  CogeCher  wich  Che  ocher  limiCaCions  of  Che  sCudy  make 
chis  efforC  a  prime  candidace  for  Che  TEA  '79  efforC.  Lc  would  be 
exCiemely  valuable  Co  incorporaCe  boCh  CAMMS  and  CATTS  in  Che  TEA  efforC. 
This  would  provide  separaCe  Craining  and  CesCing  vehicles. 

(b)  The  face  that  numerical  improvemenC  in  mean  performance  did  occur 
beeween  Che  preCesC  and  Che  posCCesC  exercises  in  46  of  Che  47  subCasks 
evaluaCed,  would  seem  Co  indicaCe  ChaC  improved  proficiency  did  occur. 

The  face  chac  only  13  of  chese  differences  achieved  scaciscical  signifi¬ 
cance  aC  0.05  level  is  more  likely  a  funecion  of  Che  small  sample  Chan  it 
is  the  absence  of  a  real  difference.  This  is  supported  by  the  consistency 
in  direction  of  the  differences.  The  same  data,  when  aggregated  by  tasks, 
produce  consistent  findings.  Only  3  of  the  12  tasks  exhibit  significant 
differences  buC  all  12  tasks  reflected  improvement  in  mean  peformance.  A 
comparison  of  Che  differences  in  mean  performance  between  the  pretest  and 
training  exercise  reveals  patterns  and  magnitudes  similar  to  those  between 
pretest  and  posttest,  but  this  does  not  hold  true  between  the  training 
session  and  posttest  session  where  much  smaller  differences  occur.  This 
apparent  reduction  in  learning  rate  is  suggestive  of  the  commonly 
hypothesized  curve. 

(c)  In  looking  at  the  results  of  analysis  of  specific  ARTEP  tasks, 
the  areas  that  consistently  presented  the  most  problems  were  intelligence, 
fire  support,  and  admin/log.  These  findings  closely  parallel  the  informal 
observations  of  the  CAMMS  research  team  and  also  correspond  to  research  on 
battalion  command  group  ARTEP  performance  previously  examined  in  CATTS 
exercises . 

(d)  In  the  comparison  of  CAMMS  battlefield  outcomes  with  various 
ARTEP  subtasks,  the  program  seems  to  be  valid.  For  example,  in  the 
correlation  of  location  of  the  enemy  thrust  with  selected  ARTEP  subtasks, 
four  negative  correlations  were  obtained  (Table  7,  p.  51): 


(1)  Determine  priority  of  fire  -0.91 

(2)  Determine  fire  support  required.  -0.85 

(3)  Conduct  inital  FSC.  -0.91 

(4)  Commo/Coord  plans  and  orders.  0.90 

(5)  Integrate  CSS  into  selected  maneuver.  -0.85 


(QL4) 


(QL4) 


(QL4 ) 
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This  is  unde  is tandab  le .  As  the  error  in  location  of  the  enemy  thrust 
grows  smaller,  performance  on  the  fire  support  subtasks  should  improve  as 
well  as  integration  of  the  admin/log  effort  into  the  scheme  of  maneuver. 

This  is  no  explanation  for  the  positive  correlation  on  Commo/Cooid  plans 
and  orders  unless  it  is  due  to  the  small  sample  size. 

(e)  On  the  basis  of  this  test,  CAMMS  appears  to  possess  most  of  the  (QL4  ) 
characteristics  associated  with  a  good  training  simulation. 

(f)  There  is  little  evidence  to  indicate  that  CAMMS  fails  to  provide  (gl.4) 
sufficient  realism  to  effectively  teach  staff  coord inat ion .  In  fact,  a 

recent  survey  by  ARI,  (Ira  T.  Kaplan  and  Herbert  F.  Barber,  "Evaluation  of 
a  Computer-Assisted  Battle  Simulation:  CAMMS  vs  a  CPX,"  undated),  rated 
CAMMS  superior  to  CPX. 

(g)  Improvements  in  the  command  group  ARTEP  should  be  continued.  (QL4  ) 

These  should  provide  more  intensive  admin/log  fire  support  and  intelli¬ 
gence  play.  Tasks,  conditions,  and  standards  should  be  rewritten  and 
reworded  to  be  more  specific. 

(h)  The  observation,  offered  by  the  CAMMS  research  team,  that  command  (QL4) 
group  performance  is  more  that  the  sum  of  the  performance  of  ARTEP  mis¬ 
sions  and  subtasks,  is  a  basic  tenent  of  ARTS.  Tactical  readiness 

(TACk)  is  the  ability  of  a  commander  and  his  staff  to  integrate  the 
complex  battlefield  systems,  mastery  of  which  is  required  for  success  on 
the  mobern  battlefield. 

(1)  Information  concerning  the  impact  of  time  assigned  to  the  staff,  (QL4) 
and  experience  and/or  schooling  for  that  particular  staff  position,  aie 
being  analyzed  at  Ft.  Leavenworth  and  will  be  forwarded  as  soon  as 
available. 

(j)  Additional  subjects  which  should  be  studied  in  the  future  (QL4) 

development  of  CAMMS  are: 

(1)  Exercise  duration. 

(2)  Number  of  successive  exercises. 

(3)  Interval  between  exercises. 

(4)  Inte rspe r s ion  with  other  types  of  individual  and  collective 
training. 
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Training  Instrumentation  Evaluation  (TIE  Test) 
Transferred  to  TEA  79  Effort 
Final  Report  due  15  December  1978. 
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Transferred  to  TEA' 79 
DATE  OF  REPORT:  TBD 
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ANNEX  B  -  TEA  '85 


OBJECTIVES  OF 
TEA  85  PROGRAM 


OBJECTIVES  OF  TEA  85  PROGRAM 

The  long  term  objective  of  the  TEA  '85  program  is  to  ensure  total 
integration  of  training,  logistics,  and  personnel  subsystems  with  hardware 
development.  This  objective  is  best  accomplished  by  precisely  defining 
requirements  to  defeat  the  threat;  early  detection  and  evaluation  of 
hardware  and  training  deficiencies;  and  determining  the  costs  to  train  and 
sustain  user  proficiency.  This  data  is  necessary  to  discriminate  training 
from  design  problems  to  allow  trade-offs  between  equipment  and  the  Army's 
capability  to  train  the  user. 


The  TEA  '85  program  seeks  Co  attain  long  term  objectives  by  use  of  a 
phased  program  that  initially  gains  insights  into  the  trainability  for 
selected  developing  systems.  By  progressively  refining  existing  proce¬ 
dures  to  a  more  sophisticated  methodology,  the  TEA  '85  program  becomes  the 
foundation  for  an  effective,  efficient  and  justifiable  training  system 
necessary  to  assimilate  new,  complex  weapons  systems.  The  TEA  '85  pro¬ 
gram  provides  data  necessary  to  allow  the  BTM  to  perform  to  design  po¬ 
tential.  To  ensure  adequate  training  and  support  throughout  a  system's 
life  cycle,  developmental  programs  must  also  consider  such  factors  as  the 
environment  of  1985,  and  pre-  and  post-  mobilization  training  require¬ 
ments. 

The  TEA  '85  effort  was  initiated  subsequent  to  the  development  of  the 
ARTS  TEA  '78  program.  Initial  ARTS  analysis  of  previous  TRADOC  actions  to 
develop  TEA,  identified  problems  in  operational  test  and  evaluation  acti¬ 
vities.  The  most  important  of  these  problems  were  determined  to  be: 

a.  Performance  criteria  is  often  not  fully  implemented;  heavy 
leliance  is  often  placed  on  individual  experience  and  subjective  asse¬ 
ssment  . 


b.  Testers  have  no  standard  concept  of  what  to  test.  Tests  are  often 
not  focused  on  the  issues  which  will  be  of  key  importance  to  unit  com¬ 
manders  once  the  new  systems  are  fielded. 

c.  Test  scenarios  and  participants  are  often  poor  representatives  of 
uset  populations  and  operational  problems. 

d.  Test  designers  often  make  inadequate  use  of  performance  analysis 
techniques  and  advances  in  educational  technology. 

e.  An  inadequate  population  of  properly  trained  testers  seems  to 
aggrevate  the  other  problem  areas. 

Members  of  the  ARTS  group  concluded  that  it  was  necessary  to  develop 
systematic  procedures  for  the  testing  of  individual  and  collective  per¬ 
formance  and  decay  during  the  testing  and  evaluation  of  developmental 
systems. 

As  a  structured  program,  TEA  '85  provides  an  effective  tool  to  aid  in 
establishing  an  efficient  training  system  for  1985.  Together  the  TEA 
process  and  BTM  provide  the  data  and  training  programs  required  by  the 
ARTS  model  training  system. 


Concept 

The  TEA  '85  proposal  was  driven  by  the  need  to  exploit  knowledge 
derived  from  the  Army  Training  Study  TEA  '78  planning  while  remaining 
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within  the  constrained  resources  imposed  by  the  planning,  programming  and 
budgeting  system  (PP8S).  These  resource  constraints  mandated  a  phased 
program  which,  in  the  early  years  would  superimpose  TEA  objectives  on 
scheduled  tests  being  conducted  by  Army  analytical  agencies.  Required 
resource  levels  were  modest  for  FY  1978-1979  as  selected  tests  involved 
platoon  and  company  sized  units.  Tests  of  greater  magnitude  were 
scheduled  for  FY  1980-1981  with  planned  application  of  the  program  to  all 
TEA/OT/DT  testing  beginning  in  FY  1962. 

INSIGHTS  INTO  TRAINABILITY  FOR  DEVELOPING  SYSTEMS 


INSIGHTS  INTO  TRAINABILITY 
FOR  DEVELOPING  SYSTEMS 


DEVELOPMENT 
OF  CORE 
OBJECTIVE 
OATA  THRU  , 
TESTING  [OFT 


CRITICAL  THREAT  TRAINING  PROGRAM  LEARNING  h  DECAY  RETRAINING 

DEFEATING  TASKS  COSTS  CURVES  FOR  REQUIREMENTS 

CRITICAL  TASKS 


Core  Objectives 

The  TEA  '85  concept  envisioned  development  of  a  test  methodology  to 
determine  specified  objectives,  referred  to  as  core  objectives,  for  each 
test.  These  objectives  are  designed  to  determine: 

a.  Critical  SM/ARTEP  tasks. 

b.  Costs  (people,  dollars,  and  time)  of  programs  to  proficiency. 

c.  Learning  decay. 

d.  Frequency  of  retraining  required. 


Test  plans  Co  colLect  core  objective  data  must  be  specifically  designed  so 
thaC  issues  key  to  the  development  of  suitable  training  subsystems  are 
examined.  Collection  plans  for  core  objective  data  must  draw  on  accurate 
job  performance  measures  to  allow  the  making  of  precise  trade-off  deci¬ 
sions  between  hardware  design  and  alternative  training  programs  earlier  in 
the  de ve 1 opme nt a  1  cycle  before  hardware  design  is  frozen. 

Consideration  of  operational  problems  affecting  the  ability  of  a  unit 
to  train  must  also  be  made  if  new  systems  are  to  be  operated  at  their 
design  capability.  The  TEA  '85  program  provides  a  framework  for  this 
invest  igat ion.  Although  problems  vary  from  institution  to  unit  and  from 
unit  to  unit,  these  problems  must  be  studied  and  resolved  to  ensure  total 
system  reliability  in  the  field.  These  type  problems  are  termed  situa- 
t  iona 1  variables. 


Situational  Variables 


While  core  objectives  apply  to  all  test,  situational  variables  tested 
will  be  peculiar  to  each  test.  Selection  of  variables  to  be  investigated 
should  be  the  result  of  predicted  variations  from  the  norm  in  the  training 
environment . 

The  ultimate  users  of  developing  systems  are  units  in  the  field. 

These  units  must  operate  under  conditions  shaped  by  variations  in  logis¬ 
tical  support,  personnel  status,  and  training  resources.  Answers  to 
questions  posed  by  these  differing  conditions  are  necessary  to  accurately 
forcast  life  cycle  system  costs.  Successful  determination  of  the  impact 
of  introducing  new  equipment  into  the  Army  and  of  the  resultant  changes 
necessary  in  the  Army  training  system,  is  largely  dependent  on  this  type 
testing.  A  list  of  the  roost  common  variables  has  been  compiled  by  the 
study  group.  While  the  following  list  is  not  all  inclusive,  it  covers 
those  areas  which  most  frequently  exist  and  which  detract  most  severely 
from  individual  and  unit  proficiency.  Detailed  definitions  are  at 
Appendix  1. 


Common  Situational  Variables 

a.  Allocation  of  taining  tasks  between  institution  and  the  unit. 

b.  Validation  of  critical  tasks  for  service  school  development  of 
how  to  train  to  combat  proficiency  at  least  cost  in  a  unit. 

c.  Determine  impact  of  transfer  of  all  or  portions  of  A1T/BT  to 

FORSCOM. 

d.  Determine  effect  of  expanded  OSUT  for  selected  high  priority 


weapons . 


e.  Develop  exportable  job  training  packages  to  support  training 
in  units. 

f.  Develop  training  packages  to  ensure  supervisor  competence. 

g.  Determine  MOS  transition  training  requirements. 

*  h.  Determine  resources  required  to  attain  unit  collective  profi- 

c iency . 

i.  Determine  effects  of  personnel  stabi } i ty /ins  tab i 1 i ty  on  profi¬ 
ciency. 

j.  Determine  effects  of  reduced  officer/NCO  fill  on  training. 

k.  Determine  effects  of  introducing  less  capable  personnel  into 
the  training  base  and  units. 

l.  Evaluate  rapid  refresher  training  programs  for  Reserve 
Component  units. 

m.  Develop  training  concepts  to  train  with  reduced  resources. 

n.  Develop  replacement  upgrade  training  programs. 

o.  Determine  training  to  exploit  enhanced  capabilities  of 
modernized  equipment. 

p.  Determine  optimal  use  of  equipment  pools  to  support  AC/RC  unit 
training. 

q.  Develop  training  programs  to  assimilate  new  equipment  in 

units . 

r.  Validate  effectiveness  and  efficiency  of  training  devices. 

s.  Develop  training  programs  to  conduct  continous  combat. 

TEA  ' b 5  Model 

Because  the  ARTS  TEA  methodology  is  broader  in  scope  and  more  compre¬ 
hensive  in  detail  than  current  TEA,  implementation  must  be  evolutionary  to 
ensure  precise  development  of  testing  methodology  and  proponent  capabi- 
^  lity.  A  prototype  methodology  has  emerged.  Additional  research,  however, 

is  necessary  for  precise  methodological  development.  TEA  *85  was  designed 
to  further  this  development  as  well  as  to  provide  key  elements  of  specific 
information  as  a  necessary  follow-on  to  TEA  '78.  In  addition,  ARTS  has 
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init Laced  construction  of  a  job  aid  for  developmental  testers  in  coor¬ 
dination  with  the  XMl  OT  II. 

This  latter  effort  combines  the  talents  of  the  USSARMC,  ARI  Fort  Knox 
Field  Office,  the  XMl  TRADOC  Systems  Manager  (TSM) ,  and  an  educational 
technology  contractor,  during  XMl  OT  II.  The  Armor  Center  (USAARMC),  will 
exercise  overall  TRADOC  staff  supervision  of  this  effort.  The  TEA  model 
emerging  from  these  efforts  should  be  consistent  with  the  instructional 
systems  development  ( I S D )  model  set  forth  in  TRADOC  Pam  350-30.  The 
conduct  of  TEA,  however,  would  be  broadened  in  accordance  with  the 
following  model  to  develop  a  means  to  link  performance  deficiencies  to  all 
causative  factors. 

a.  Front  End  Analysis 

1)  Derive  task  list 

2)  Describe  target  population  to  include  motivation 

3)  Describe  training  environment 

b.  Design/Development  Phase 

1)  Derive  objectives 

2)  Derive  criterion  tests 

3)  Prepare  training  packages 

c.  TEA  Testing  Phase 

1)  Conduct  the  training 

2)  Data  collection 

a)  Skills  and  knowledge 

b)  Environmental  considerations  such  as  instability,  low 
present-for-training  strength,  shortage  of  officer/NCOs,  less  capable 
soldiers,  leader  behavior  and  knowledge,  and  equipment  design. 

c)  Motivational  incentives  such  as  pay,  leadership,  promotion, 
and  ergometrics. 


3)  Actual  performance 


a)  Skills  and  knowledges 

b)  Environmental  factors 

c)  Motivational  factors 
4)  Deficiencies 

a)  Individual  tasks 

b )  Collective  tasks 

c )  Command  group  tasks 

d.  Evaluation  Phase  (analyze  performance  discrepancies) 

1)  Course  of  instruction  (COI)  content;  did  we  lose  performance  in 
app 1 icat ion? 

2)  Did  training  cause  immediate  learning?  If  not,  why  not? 
(Environment?,  Motivation?,  COI). 

3)  What  is  the  transfer  to  job  performance?  If  not  transferred  to 
job,  why  not?  (Learning  decay?,  COI?). 

4)  Worth  =  value/cost.  This  is  essentially  the  resource  input 
converted  to  job  performance  output. 

e.  Revision 

1)  Change  COI. 

2)  Change  environment. 

3)  Change  motivation. 

f.  Rear  End-Analysis 

1 )  Diagnost  ic . 

2)  Environment. 

3)  Motivation. 

4)  Critical  Task  Redefinition. 


The  first  iteration  of  testing  is  based  on  existing  factors,  i.e., 
target  population  and  conditions  existing  in  units.  Subsequent  excursions 
test  appropriate  situational  variables  to  obtain  decision-making  data,  and 
to  provide  updated  information  to  the  BTM  data  base  current  with 
introduction  of  the  weapon/equipment.  Full  development  of  this  model  will 
begin  in  conjunction  with  the  XM1  OT  II  program. 

Initial  systems  scheduled  by  TRADOC  for  future  TEA  during  FY  79  and  hi 
include  the  following: 


System: 

AHAMS 

IFV/CFV 

DIVAD 

Firef  inder 

Proponent : 

INF 

INF 

ADA 

FA 

System: 

AAH 

UET 

Proponent : 

AVN 

ENGINEER 

The  TRADOC  FY  1979/1980  command  operating  budget  estimate  (CUBE ) 
resource  computation  summary  to  support  the  initial  testing  is  as 
foil ows : 


a.  FY  1979: 

(1)  Methodology  development,  30QK. 

(2)  Test  support  to  test  agencies,  1000K. 

(3)  Training  subsystem  front-end  analysis  and  evaluation  (3MY/system 
X6  system  =  18  MY). 

(4)  Travel,  24K. 

Total:  18  MY  $1659K 

b.  FY  1980 

(1)  Test  support  to  test  agencies,  200K. 

(2)  Training  subsystem  front-end  analysis  and  evaluation  (3  MY/system 
=  18  MY). 

( 3  )  T lave  1 ,  24K. 


Total :  18  MY 


$2  359K 


SUMMARY  OF  TEA  '«5  CONCEPTS 


The  ultimate  purpose  of  TEA  in  the  future  should  be  the  ic-alization  oi 
efforts  in  TEA  ' 7  to— 1  a  5  leading  to  integration  of  tiaining  requirements 
into  the  total  system  development  cycle.  The  investigation  of  human  pe i - 
formance  data  is  necessary  to  ensuie  the  timely  and  effective  assimilation 
of  trainable  systems  into  units  in  the  field.  ARTS  TEA  concepts  have 
evolved  from  studies,  tests  and  suiveys.  These  concepts  aie  designed  t j 
ensure  integration  of  logistics,  haidwaie,  tiaining  iesouii.es  and  job 
performance  requirements  thioughout  the  development  cycle.  TEA  'ifc 
results  indicate  that  required  job  peifoimance  cannot  bt  leliablv  attained 
and  maintained  unless  equipment,  job  peifoimance  aids,  training  piogiarrs 
and  doc  ume  nc  a  c  i  on  match  the  type  soldiet  ptojeett-d  to  be  us  the  we  ap.m 
system  or  equipment  as  operate! s  and  leadeis.  Kui the l ,  aspects  of  the 
significant  variations  in  unit  operating  envi  i  onment  s  have  be  on  to  ..ad  t  j 
degrade  job  perfoiroance.  This  mandates  that  human  peitoinance  laa  is 
should  be  evaluated  under  differing  conditions.  Tht  se  conditions  i  ns  1  ice 
vaiiations  in  the  capability  of  troops,  shortage  of  offi>_ei  NcU  tia.ruis, 
various  types  and  levels  of  personnel  instability,  and  equipment  or 
tiaining  resouice  shoitages.  All  of  these  conditions  have  been  found  to 
be  present  in  units  to  some  degree.  Conditions  such  as  these  result  in 
the  lowering  of  individual  and  collective  proficiency  be  1 ow  acceptable 
standards. 

Future  TEA  must  ensure  that  factual  evidence  icgaiding  system  train- 
ability  is  collected  early  in  the  developmental  cycle.  Peifoimance 
requirement  s  analysis  must  be  initiated  as  early  as  OT  I  to  ensure  that: 

a.  Training  and  human  factors  aie  examined  during  concept  formulation 
to  permit  uset  performance  goals  to  be  coordinated  with  the  ptojected  Airny 
capability  to  man  the  equipment.  This  will  requite  that  leseaich  be  done 
sutticiently  early  in  the  system  life  cycle  to  permit  reasonable  haidwaie/ 
training  trade-offs.  The  ability  to  make  these  trade-offs  early  and  with 

a  high  degree  of  confidence  is  essential  to  the  attainment  of  peifoimance 
gials  at  minimal  development  and  lifetime  operating  and  support  costs. 

b.  Human  factors  testing  methodology  is  improved  to  permit  the 
separate  identification  of  haidwaie  deficiencies  and  peisonnel  and 
tiaining  or  tiaining  support  deficiencies. 
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Proposed  TEA  '85  Test  Program 
for  FY  1980-1981 


The  FY  1980-1981  TtA  program  should  continue  efforts  made  in  FY  1979- 
1980  to  broaden  the  ARTS  TEA  methodology  to  developing  systems.  A 
recommended  program  leading  to  full  application  to  test  and  evaluation 
activities  conducted  in  FY  1982  and  beyond  is  listed  below: 


Sy s  ten 


Dates 


System 


Dates 


Patriot  OT  II 
AN/TPQ37  OT  II 
XM1  or  III 
S  I  NCCAP.S  OT  I 


Jul  -  Oct  1979 
Feb  1980 
Jun  -  Dec  1980 
Jan  -  Apr  1981 

TBD 


Combined  Arms 
Bn  Level  Simulation 

(MILES  ) 


National  Train-  May  1981 

ing  Center 
CAMMS  Follow- 
on 

Reserve  Component  Jun  1981 

Modular  Training 
—  Combined.  Arras 

-  ENGR  Bn 

-  CSS  Bn 

-  TACR 


FY  1982-1985 

Beginning  in  FY  1982,  all  new  equipment  should  be  tested  under  the 
Tiaining  Effectiveness  Analysis  program. 
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Appendix  i  to  Annex  B 
Core  Objectives  and  Situational  Variables 

COKE  OBJECTIVES 


A.  CONTINUE  VALIDATION  OF  THREAT  OklENTED  CRITICAL  SM/ARTEP  TASKS,  CON¬ 
DITIONS,  STANDARDS.  “  ~~ 

CHALLENGE:  Continuation  of  critical  task  identification  through  docu¬ 

mented  front-end  analysis  for  weapons /equipments  and  units/jobs  is  an 
essential  part  of  the  Army  Training  System. 

CONCEPT:  Training  analysis  will  continue  to  form  the  basis  for 

training  development  decisions.  Modification  to  training  analysis  meth¬ 
odology  will  be  limited  to  that  necessary  to  ensure  continuity  with 
situational  variables  and  other  core  objectives. 

B.  DETERMINE  TIME/COSTS  TO  ACHIEVE  OPTIMAL  PROFICIENCY  FOR  CRITICAL 
INDIVIDUAL/COLLECTIVE  TASKS. 

CHALLENGE:  To  justify  training  resource  requirements,  it  is  necessary 

to  quantify  costs  attributable  to  attaining  optimal  proficiency.  Once 
these  costs  are  established,  resources  to  support  training  requirements/ 
missions  allocation  and  reallocation  between  the  training  base  and  units 
in  the  field  can  be  made  rapidly  and  accurately. 

CONCEPT:  The  ARTS  developed  training  resource  methodology  will  become 

a  part  of  training  development  methodology. 

C.  CONTINUE  TO  DEVELOP  DIAGNOSTIC  TESTS  TO  MEASURE  INDIVIDUAL/COLLECTIVE 
LEARNING  DECAY  LEVELS. 

CHALLENGE:  Ind  i  v idua 1 /co  l  le c t  i  ve  learning  decay  rates  must  be 

determined  for  each  weapon  and  equipment  sy s tem/un  i  t / job  in  order  to 
quantify  existing  proficiency  levels  and  to  fund  requirements  to  obtain 
optimal  pioficiency. 

CONCEPT:  Training  analysis  during  testing  is  to  be  designed  to 
measure  skill  acquisition  and  learning  decay  over  time  by  use  of 
diagnostics  and  retraining  time.  Development  of  diagnostic  testing  is 
ciitical  to  success  as  retraining  requirements  must  be  based  on  the  Delta 
between  proficiency  attained  at  completion  of  training  and  subsequent 
residual  pioficiency.  In  othei  words,  only  that  which  has  been  lost  is 
retrained,  not  that  which  has  been  retained. 

D.  DETERMINE  FREQUENCY  OF  RETRAINING  REQUIRED  TO  SUSTAIN  OPTIMAL  PROFI¬ 
CIENCY  FUR  I ND I VI DUAL /COLLECTIVE  TASKS  (T I ME /COSTS  ) . 

CHALLENGE  AND  CONCEPT:  See  Objective  C  above. 


COKE  OBJECT IVES 


EEA 


A.  Continue  validation  of  threat  oriented  cr i t ica 1  SM/ARTEP  tasks,  con¬ 
ditions,  standards. 

(1)  Are  SM  tasks/ARTEP  events  based  on  the  documented  results  of 
appropriated  front-end  analysis  techniques? 

(2)  Are  ARTEP  events  supported  with  prerequisite  SM  tasks? 

(3)  Was  performance  of  SM/ARTEP  tasks  actually  necessary  for  the 
accomplishment  of  a  specific  mission  (i.e.,  Was  it  truly  a  critical 
task?)? 

(4 )  Is  the  specific  level  of  proficiency  greater  than,  equal  to,  or 
less  than  that  required  to  meet  the  threat? 

B.  Determine  tima/costs  to  achieve  optimal  proficiency  for  critical 
i  nd  i  v idua 1 /co 1 lec t i ve  tasks. 

(1)  What  resources  are  required  in  the  institution? 


(a) 

Do  1  lars 

(e) 

Dollars  and  time 

(b) 

People 

(f) 

People  and  time 

(c) 

T  ime 

(g) 

Dollars,  people, 

and  time 

(d) 

Do  1  lars 

and 

people 

What 

resources  are  required  in  the  i 

unit? 

(a) 

Do  1  lars 

(e) 

Do  1  lars  and  t ime 

(b) 

Peop  le 

(f) 

People  and  time 

(c) 

T  ime 

(g) 

Dollars,  people, 

and  time 

(d) 

Do  1  lars 

and 

people 

(3)  Does  the  collected  data  reflect  deviation  from  real-world 
normalcy,  i.e.,  validity  of  trainee/instructor,  NCO/officer  fill,  unusual 
environmental  constraints  or  advantages? 

C.  Continue  to  develop  diagnostic  tests  to  measure  ind ividua 1 /co 1 lect ive 
learning  decay  levels. 

(1)  Do  current  tests  account  for  learning/decay  which  occurs  sub¬ 
sequent  to  course/period  of  instruction? 
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(2)  Does  Che  diagnose  ic  test  program  provide  for  testing  at  two  or 
more  data  points?  (i.e.,  3u,  bU,  &  180  days  after  training). 

(3)  Do  diagnostic  tests  provide  data  to  determine  specific  ski  !  !  / 
proficiency  loss  and  retraining  to  proficiency  required  (i.e.,  make  the 
corrective  action  obvious)? 

(4)  What  is  the  training  resource  requirement  to  reacquiie  mastery 
after  various  intervals  subsequent  to  the  original  training  program? 

(Note:  All  training  activity,  or  lack  thereof,  must  be  considered.  ) 

D.  Determine  decay  rates  and  frequency  of  retraining  requited  to  ■■obtain 
optimal  proficiency  for  i  nd  i  v  idua  1 /co  1  lec  t  i  ve  critical  tasks  (tir-  <.usts). 

(1)  What  rs  the  time  to  initially  learn  a  skill  to  mastery? 

(2)  After  specified  intervals  without  practice,  what  is  the  rim. 
required  to  relearn  a  skill  to  mastery? 

(3)  Within  task  performance,  which  elements  are  forgotten  first? 

(4)  WhaC  is  the  frequency  of  retraining  or  practice  necessary  r j 
ensure  retention  of  a._^eptable  levels  of  proficiency? 


w 


r.  ■ : 

e.  : 

r.  : 


situatiunal  variables 


i.  Reduce  length  of  selected  courses  for  high  density /low  technology  MOSs 
vs.  low  density/high  technology  MOSs. 


2.  He  source s /e f feet  of  training  common  versus  technical  skills  only  in 


institution. 


No  longer  used  in  TEA. 
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3.  Allocation  of  training  tasks  between  institution/unit. 

p 

CHALLENGE:  Resources  required  to  train  to  proficiency  in  collective/ 

individual  tasks  vary  as  a  function  of  the  type  task.  Acceptable  levels 
of  decay  in  proficiency  vary  with  the  missions  assigned  to  the  unit.  It 
is  necessary  to  identify  required  resources,  rates  of  decay  for  critical 
tasks,  and  retraining  frequencies.  Such  determination  will  form  the  basis 
for  allocation  of  training  resources. 

CONCEPT:  Data  should  be  extracted,  as  available,  from  tests  as  to 

time  and  training  methods  to  train  to  individual  proficiency.  Post 
training  diagnostic  tests  administered  to  determine  proficiency  decay  of 
critical  skills  over  time  can  be  one  indicator  of  what  training  is  best 
conducted  in  the  unit  or  institution.  Skills  with  lengthy  retention,  best 
taught  with  sophisticated  training  aids,  are  best  taught  in  the  training 
base.  Conversely,  skills  of  short  retention  with  hands-on  practice  re¬ 
quired  to  maintain  proficiency,  are  best  taught  in  the  unit.  This  deter¬ 
mination  will  be  a  function  of  the  degree  of  s imul at  or / ins t r uc tor  inten¬ 
sive  support  required  and  the  rate  of  past  training  decay.  (See  TRADOC 
Pamph let  330-30  )  . 


4.  Validation  of  selected  critical  tasks  for  service  school  development 
of  how  to  train  to  combat  proficiency  at  least  cost  in  a  unit. 

CHALLENGE:  Commanders  need  advice  concerning  how  to  use  their  limited 

resources  to  train  to  combat  proficiency.  Critical  tasks,  both  individual 
and  collective,  once  threat  validated,  must  be  selected,  aggregated,  then 
with  the  addition  of  conditions  and  standards  formulated  into  battle 
drills  so  that  the  unit  commander  can  utilize  the  principle  of  integrated 
training  to  train  to  combat  proficiency  at  the  least  cost.  Such  a  program 
of  battle  drills  needs  to  be  tested. 


CONCEPT:  Critical  tasks  should  be  selected  and  validated.  They 

should  then  be  aggregated  in  a  logical  fashion  and  shaped  into  bottle 
drills.  Tests  should  be  developed  to  measure  the  changes  in  proficiency 
as  well  as  costs  involved  in  this  type  of  training.  Data  drawn  from  these 
tests  can  be  compared  to  the  baseline,  that  data  obtained  from  testing 
using  the  commander's  previous  training  program. 


5.  Determine  impact  of  transfer  of  all  or  portions  of  AIT/BT  to  FORSCOM. 


CHALLENGE:  To  determine  a  cost  efficient  policy  for  training  ,entry 

level  soldiers  to  proficiency  in  common  and  MOS-related  skills.  The 
feasibility  of  providing  only  basic  training  for  selected  skills. in  the 
training  base  needs  to  be  tested. 


CONCEPT:  The  test  would  be  conducted  by  providing  to  units  replace¬ 

ment  personnel  in  selected  MOS  who  have  completed  only  common  skills  basic 
training.  The  unit  would  be  required  to  train  all  such  personnel  to 
proficiency  in  MOS-related  skills  without  increase  in  current  ALO.  TRADOC 
schools  would  provide  the  training  packages  and  MTT's  to  ensure  supervisor 
competence  as  required.  Training  within  the  unit  should  be  conducted  on  a 
schedule  as  desired  by  the  commander,  excepting  that  proficiency  required 
be  established  by  the  proponent  school.  Evaluation  of  comparative  costs 
and  the  effects  of  this  additional  training  load  on  unit  readiness  will  be 
determined  by  comparison  to  OSUT  cos ts /prof ic iency  with  a  baseline  unit  by 
test  agency  evaluation  of  resultant  individual  and  unit  proficiency. 


6.  Impact  of  transfer  of  BT  to  FORSCOM 

7.  Impact  of  transferring  all  entry  level  training  to  FORSCOM 

8.  Impact  of  transfer  of  all  except  critical  task  training  to  FORSCOM 

9.  Impact  of  transfer  of  all  except  high-technology  task  training  to 
FORSCOM 

10.  Effect  of  expanded  BT  to  develop  cross-training  in  support  MOS 


11.  Determine  effect  of  expanded  OSUT  for  selected  high-priority  weapons 


CHALLENGE: 
level  soldiers 
effect  on  unit 
proficiency  on 


To  determine  a  cost  policy  for  training  selected  entry 
in  common  and  high  priority  weapon  system  skills-.  The 
training  and  costs  of  providing  training  to  maximum 
critical  tasks  in  the  training  base  needs  to  be  tested. 


CONCEPT:  The  test  would  be  executed  over  an  extended  period  by  con¬ 

ducting  entry  level  training  to  varying  levels  of  proficiency  by  expanding 
selected  OSUT.  Testing  will  involve  control  and  test  groups.  Postgrad¬ 
uation  testing  to  determine  learning  decay/retraining  rates  between  test 
and  control  groups  will  provide  data  needed  to  design  training  programs. 
These  programs  provide  a  basis  for  timely  resource  distribution  to  ensure 
enhanced  individual  skill  proficiency  and  retention  for  high  priority 
weapons  systems. 


12.  Develop  exportable  job  training  packages  required  to  support  training 
in  units 

CHALLENGE:  To  rapidly  train,  sustain,  or  retrain  so ldiers /uni ts  in 

skills  when  the  situation  does  not  permit  conventional  training  or  when 
the  skill  can  be  more  adequately  taught  by  use  of  training  packages. 

CONCEPT:  The  concept  is  to  prioritize  skills  which  are  critical  and 

then  teach  these  skills  in  a  intensively  structured  series  of  individual/ 
collective  training  periods.  Maximum  use  of  training  packages  will  be 
made.  Testing  will  center  on  comparative  analysis  of  costs  and 
proficiency  attained  over  time  against  a  baseline  of  similar  proficiency 
levels  attained  through  conventional  training.  Consider  the  following  in 
sequence : 

a.  Job  performance  aids 

b.  Self-teaching,  exportable  packages 

c.  Forma  1 /supe rvised  OJT  programs 

d.  Installation  (shadow)  or  unit  schools 


13.  Develop  training  packages  to  ensure  supervisor  competence 

CHALLENGE:  Trainers  must  be  taught  efficient  and  effective  methods  of 

training. 


CONCEPT:  Packages  will  be  developed  for  use  by  mobile  training  teams 

from  appropriate  service  schools.  Various  training  packages  will  be 
devised  and  tested.  Test  data  will  be  used  to  prepare  packages  which  will 
permit  mobil  training  teams  to  train  supervisors  to  competence  in  the 
field.  Packages,  as  well  as  the  mobile  training  team  concept,  will  be 
evaluated . 
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lu.  Determine  MOS  transition  training  requirements 

CHALLENGE:  To  rapidly  train  soldiers  to  the  10-30  skill  level  on 

specific  weapons  and  equipment.  This  is  an  integral  part  of  new  equipment 
assimilation  training  for  both  Active  and  Reserve  Components.  In 
addition,  MOS  imbalance  must  be  readdressed  and  precorabat  refresher 
training  must  be  accomplished  by  MOS  transition  training. 

CONCEPT:  Critical  skills,  by  system,  must  be  put  in  priority.  Only 

cirtical  skills  will  be  taught.  Testing  will  measure  proficiency  attained 
in  a  new  critical  skills  and  retention  of  less  critical  common  skills. 

Data  will  enable  planners  to  quantify  resource  requirements  and  to  design 
job-oriented  training  programs  and  job-training  packages.  This  testing  is 
suitable  for  both  Active  and  Reserve  Component  units  during  premobiliza¬ 
tion  and  post mobilization. 
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15.  Determine  resources  required  to  attain  unit  collective  proficiency 


CHALLENGE:  It  is  necessary  to  determine  the  resources  required  to 

attain  and  maintain  co 1 lect ive/ind ividua 1  proficiency  for  specific 
critical  tasks,  conditions,  and  standards  in  order  to  establish  and  then 
justify  required  resources  for  training  time  (men,  equipment,  time,  POL, 
ammunition,  simulators,  etc.). 


CONCEPT:  Resources  required  to  train  units  to  proficiency  will  be 

determined  during  testing.  Data  will  be  extracted  which  will  allow  deter 
mination  of  the  resources  necessary  for  a  type  unit  to  attain  required 
standards  of  proficiency  in  critical  tasks  under  specific  conditions. 
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16.  Determine  effects  of  personnel  stab i 1 i ty / ins  tab i 1 i ty  on  proficiency 

CHALLENGE:  Lack  of  personnel  stability  results  in  lengthened 

training/retraining  time  to  achieve  collective  proficiency  in  critical 
task  skills  as  well  as  accelerated  decay  of  collective  proficiency. 

CONCEPT:  Testing  the  effects  of  instability  and  stability  envisions 

introducing  controlled  instability  or  quantifying  existing  instability  in 
the  training  environment  (within  crews  and  within  companies)  and  then 
measuring  the  proficiency  change  in  contrast  to  the  proficiency  of  more 
stabilized  crews/units.  This  should  permit  determination  of  the  increased 
resources  and  time  necessary  to  attain  and  maintain  ind i v idua 1 /co 1  le c t i ve 
proficiency  when  there  is  high  personnel  instability  by  determining  the 
increased  frequency  required  to  maintain  a  desired  level  of  proficiency. 
Consider  also: 

a.  Effects  on  unit  training  programs  (continuity) 

b.  Effects  on  development  of  leadership 

c.  Attitudes  on  training  such  that  retraining  frequency  is  changed 


17.  Determine  effects  of  reduced  officer/NCO  fill  on  training 

CHALLENGE:  A  low  percentage  of  officer/NCO  fill  interacts  with  other 

unit  training  distractors  (turbulence,  troop  diversions,  authorized 
absences,  etc.)  to  degrade  training  effectiveness  and  proficiency. 

CONCEPT:  Testing  the  training  effects  of  various  levels  of  officer/ 

NCO  fill  is  required.  Data  will  be  extracted  to  enable  determination  of 
the  resources  required  at  different  levels  of  officer/NCO  fill  to  attain 
ind ividua 1 /co  1  lect ive  critical  task  proficiency  and  to  establish  the  type 
and  frequency  of  retraining  necessary  to  maintain  that  proficiency. 


18.  Determine  effects  of  introducing  less  capable  personnel  into  the 
training  base  and  units 


CHALLENGE:  The  Stragegic  Studies  Institute  study,  "Army  Environment, 

1985-1995,"  predicts  that  the  typical  incoming  soldier  of  1985  will  be 
less  capable  of  mastering  complex  training  than  his  comparable  peer  today 


CONCEPT:  Testing  the  effects  of  less  capable  trainees  envisions  that 

special  attention  be  paid  under  controlled  conditions,  to  determine  the 
problems,  if  any,  which  result.  Testers  should  identify  less  capable 
personnel  participating  in  test  activities  and  seek  to  determine  whether 
additional  resources  are  needed  to  bring  these  soldiers  to  average 
piofioiency.  Tne  effects  that  application  of  these  additional  resoui ces 
have  on  other  trainees  and  unit  training  programs  should  also  be 
quantified.  A  range  of  solutions  applicable  to  a  specific  set  of  tasks, 
conditions,  and  standatds  should  be  obtained.  Data  will  be  extracted  to 
assist  in  ue  t  e  i  t.  i  na  t  i  on  of  personnel  selection  criteria. 
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19.  Evaluate  rapid  refresher  training  programs  for  Reserve  Component 
units 


CHALLENGE:  Reserve  Component  units  must  be  rapidly  trained  up  with 

refresher  training  to  peak  critical  task  skills  prior  to  deployment  (Pre 
and  post  M-day). 


CONCEPT:  Train-up  packages  for  critical  systems  and  units  must  be 

designed,  fielded,  and  validated  for  Reserve  Component  units.  Packages 
should  be  designed  such  that  training  can  be  accomplished  by  RC  trainers 
These  trainers  must  produce  units  trained  to  combat  proficiency  in  the 
shortest  time,  both  premobilization  and  postmobilization.  After  the 
packages  have  been  validated  at  company  level,  battalion  level  packages 
will  be  developed.  In  addition,  further  packages  should  be  devised  to 
rapidly  train  up  troops  who,  after  deployment,  are  issued  new  and 
different  equipment.  Training  packages  (modular  training)  will  be 
administered  to  RC  units.  Post-training  proficiency  will  be  measured 
against  baseline  units  trained  under  existing  RC  programs.  Costs  to 
proficiency  and  levels  of  proficiency  will  be  compared  to  validate 
training  modules  and  to  provide  necessry  feedback  to  modify  modules  as 
necessary. 
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!'t  1,-p  training  concepts  to  train  with  reduced  resources 

<.  riAI.Lr.  NjE  :  Fiaining  systems  must  be  devised  to  enable  the  institution 
..nits  to  train  to  proficiency  with  decremented  resources. 

Nchi’I':  T :  a  i  r.i  ng  progi  am  foi  testing  will  be  analyzed  to  identify 

•r  advanced  ot  innovative  training  techniques  which  result  in  a  degi te 
: d 10 iei>.y  at  induced  lesources.  The  effectiveness  of  these  innova- 
piogiams  should  be  validated  dut ing  testing  and  reports  prepared 
n  document  f  .11 y  the  tesoutces,  training  events,  and  level  of  prof i- 
cy  attaint d.  Where  possible,  decay  lates  foi  proficiency  thus  ob- 
ei  should  oe  ill  tucined  and  compaied  to  conventional  training  decay. 
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21.  Develop  replacement  upgrade  training  programs 


CHALLENGE:  The  high-low  mix  of  major  equipment  items  mandates  that 

replacement  soldiers  will  need  rapid  transition  training  on  the  type  of 
equipment  they  will  be  using  in  combat.  The  need  for  replacement  training 
upgrade  will  be  found  in  areas  close  to  the  scene  of  combat  where  training 
time  will  be  severely  limited. 


CONCEPT:  Packages  will  be  designed  to  rapidly  train  replacements  to 

proficiency  in  the  use  of  various  weapons  and  other  items  of  equipment. 
Once  devised,  packages  will  be  evaluated  through  field  testing  and  revised 
as  necessary.  Tests  will  be  run  on  selected  equipment.  Once  the  concept 
is  validated,  packages  will  be  developed  for  other  combat  critical 
equipment . 
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_  d .  Determine  training  Co  exploit  enhanced  capabilities  of  modernized 

6  ^  u  l  p  n  c 

CHALLENGE:  The  Army  is  purchasing  enhanced  capability  in  the  form  of 

armor,  speed,  maneuverability,  fire  power,  and  target  acquisition  capabi¬ 
lities  in  its  modernizaion  program.  The  training  system  for  1985  must 
provide  ind ividua 1 • co 1 lect i ve  skills  to  ensure  the  exploitation  of  this 
enhance a  capability. 

CONCEPT:  Testing  will  entail  a  broad,  comprehensive  evaluation  of  the 

programs,  techniques,  and  technology  available  to  train  commanders, 
staffs,  units,  and  individuals  in  the  critical  skills  required.  Data  will 
be  extracted  to  enable  design  and  support  of  a  training  system  to  impart 
requisite  skills  on  a  train  and  retrain  basis  to  ensure  maintenance  of 
proficiency.  For  example,  the  speed,  increased  armor  protection,  target 
acquisition,  and  kill  capabilities  of  the  XM1  pose  major  individual/ 
collective  training  challenges  which  must  be  satisfied  to  realize  the 
potential  of  this  weapon  system.  Similarly,  the  repair  of  combat  damage 
to  this  type  system  must  be  trained. 


23.  Determine  optimal  use  of  equipment  pools  to  support  AC/RC  unit 
training 


CHALLENGE:  With  a  significant  portion  of  the  Army's  equipment 

positioned  abroad,  there  is  insufficient  equipment  to  fully  equip  AC  and 
RC  units.  Those  units  which  are  short  equipment  must  be  provided  a 
validated  training  methodology  to  ensure  maintenance  of  individual  and 
collective  proficiency. 


CONCEPT:  One  solution  to  this  problem  is  the  use  of  equipment  pools. 

This  technique  will  be  evaluated  through  testing  in  conjunction  with  other 
battalion-sized  field  tests.  Data  yielded  will  be  used  to  determine  the 
advantages  and  disadvantages  as  well  as  the  costs  involved. 
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24.  Develop  training  programs  to  assimilate  new  equipment  in  units 


CHALLENGE:  Training  developments  for  major  systems  occur  within  the 

context  of  the  total  systems  acquisition  process.  Training  subsystems 
must  be  designed  and  tested  at  each  stage  of  the  process.  The  interaction 
of  the  human  engineering  effort  and  the  cost  to  train  to  proficiency  must 
be  evaluated  and  quantified  to  facilitate  des ign/training  trade-offs. 


CONCEPT:  Tests  will  be  conducted  to  develop  training  systems  needed. 

Trained  personnel,  resources,  and  technical  support  will  be  evaluated  to 
determine  their  capability  to  carry  out  required  miss  ions /act ivi t ies 
concurrent  with,  and  subsequent  to,  fielding  new  equipment.  Data 
extracted  from  tests  will  be  incorporated  in  life  cycle/system  management 
mode  1  s . 
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25.  Validate  effectiveness  and  efficiency  of  training  devices 

CHALLENGE:  Training  devices  are  developed  in  concert  with  the  major 

system  they  are  designed  to  support.  Care  must  be  taken  to  ensure  that 
skills  developed  on  training  devices  are  reliably  transferable  to  the 
actual  system.  Further,  these  skills  must  be  those  necessary  for 
development  of  proficiency. 

CONCEPT:  Testing  will  be  designed  to  compare  individual/collective 

performance  of  actual  tasks  after  training  on  training  devices.  A 
comparison  to  training  conducted  exclusively  on  the  real  equipment,  and  in 
mixes  of  devices  and  real  equipment,  will  be  made.  Costs  to  proficiency 
will  be  compared  and  use  of  training  devices  to  reinforce  and  retrain 
decayed  skills  will  also  be  measured. 


26.  Develop  training  programs  to  conduct  continuous  combat 

CHALLENGE:  Continuous  combat  is  made  possible  by  equipment  systems 

that  enable  effective  combat  and  movement  at  night.  This  potential, 
however,  cannot  be  realized  without  an  equivalent  capability  in  every 
essential  element  of  combat  an  associated  combat  support  and  combat 
service  support  areas.  Training  programs  required  to  achieve  this 
capability  are  largely  unknown. 

CONCEPT:  Testing  will  be  designed  to  maximize  realization  of 

equipment  potential  by  identifying  those  critical  tasks/skills  required 
fight  continuously.  Associated  combat  service  support  as  well  as  combat 
and  combat  support  critical  tasks  will  be  identified.  This  will  enable 
design  of  training  systems  to  enable  the  Army  of  1985  to  attain  a 
continuous  combat  capability  compatible  with  equipment  capability  and 
emerging  doctrine. 


A  detailed  analysis  of  completed  TEA  ’78  results  and  a  review  of  tests 
yet  to  be  concluded  establish  a  requirement  for  additional  testing.  The 
TEA  '79  test  program  has  been  designed  by  ARTS  to  fulfill  three  require¬ 
ments  : 

a.  The  need  to  finish  tests  not  completed  in  the  TEA  '78  program. 

b.  The  need  to  retain  the  momentum  gained  during  the  conduct  of  the 
ARTS  Study  and  to  refine  survey  derived  data  currently  factored  into  the 
BTM, 

c.  The  need  to  continue  refinement  of  the  TEA  methodology  to 
facilitate  transition  to  future  TEA  efforts  in  TEA  '85. 

TEA  '79  Tests 

Eleven  ongoing  studies  from  TEA  '78  have  been  incorporated  in  the  TEA 
'79  program.  The  following  eleven  studies  are  ongoing  parts  of  the 
overall  TEA  '78  effort  and  will  be  completed  during  the  TEA  '79  framework 
Individual  test  information  is  included  in  Appendix  1,  TEA  '78  Management 
System  Package  to  Annex  A. 


SWT /Test  Agency 

Test  T itle 

Reported  Dated 

M60A1 

Modular  Training  for  RC 

Final  4Q  FY  1979 

M60A1 

Scaled  Range  Sub  Caliber  Test 

Phase  I  30  Aug  1978 
Final  Est  9  Nov  1978 

M60A1 

XMl ,  OT  II 

Final  Est  Jan  1979 

row 

TOW  TEA  Test 

TBD 

FO 

Forward  Observer  (FO)  Unit 
Training  Test 

Final  1  Oct  1978 

FO 

Observed  Fire  Trainer  CTEA 
Expans  ion 

Final  1  Jan  1979 

FO 

Suitability  of  13F  Exportable 
Training 

F inal  13  Feb  1979 

FO 

Tacfire  OT  III 

TBD 

CDEC 

Training  Instrumentation 
Evaluation  (TIE)  Test 

Final 

Est  13  Dec  1978 

A  R I 

Cannon  Crew  Turnover  Test 

Est  2  Q  FY  1979 

ARI 

Proficiency  and  Retention  of 
Common  AIT  Skills 

Est  1  Q  FY  1979 

Note:  Core  objectives  and  situational  variables  for  these  tests  are 

listed  at  Appendix  1  to  this  Annex. 

Test  initiatives  include  research  into  tank  crew  performance  poten¬ 
tial  through  stabilization;  follow-on  command  group  training  through  use 
'f  CAMMS  and  CATTS  with  eventual  verification  of  proficiency  gained  on  an 
instrumented  battlefield;  XM1  OT  II;  and  additional  testing  of  performance 
decay  under  more  controlled  conditions.  The  program  also  includes  plans 
to  test  units  trained  with  the  multiechelon,  integrated  training  and 
battle-drill  battalion  training  programs  designed  with  the  aid  of  the  BTM, 
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by  members  of  the  ARTS  study  group.  These  new  initiatives  and  other  tests 
will  be  discussed  in  detail  later  in  this  appendix. 


SWT 


CONCEPTUAL  ORGANIZATION 
FOR  TEA  79 


I  '"''I,,. 


SCHOOL 

COMMANDANT 


ASST  SCHOOL 
COMMANDANT 


STAFF  AND 
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•  OFFICER  SHOULD  BE 
BRANCH  QUALIFIED. 
•  ONE  OFFICER  SHOULD 
BE  CRSA  QUALIFIED. 
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Conceptual  Organization  for  TEA  *79 

The  TEA  '78  effort  has  provided  cells  of  experienced  personnel  in 
participating  schools  and  supporting  agencies.  The  experience  and 
momentum  from  TEA  '78  is  required  to  ensure  continuity  of  effort. 
Experience  gained  during  the  ARTS  study  suggests  that  a  small  number  of 
personnel  augmented  by  subject  matter  experts  as  required  should  be 
assembled  for  each  proponent  service  school.  Typically,  this  nucleus 
could  be  one  LTC/GS14,  and  one  MAJ/GS13  (one  of  whom  is  ORSA  qualified) 
augmented  by  one  senior  NCO  and  necessary  administrative  support.  As  the 
responsibility  for  TEA  requires  coordination  across  the  broad  spectrum  of 
service  school  directorates,  the  System  Work  Team  (SWT)  should  be  posi¬ 
tioned  under  the  school  Commandant,  a  level  where  such  coordination  is 
normally  done.  Concurrent  with  the  development  of  an  organizational 
structure,  the  required  funding  to  include  adequate  travel  funds  must  be 
jus t i fled . 

A  phased  approach  to  institutionalization  appears  appropriate.  A 
recommended  approach  for  FY  1979  is  to  continue  the  TEA  78  SWT  as 
presently  organized  and  to  establish  new  SWT  as  additional  schools  become 
involved  in  testing.  In  FY  1980  it  would  appear  appropriate,  if  TEA 
development  has  proceeded  as  planned,  to  integrate  the  SWT  into  the 
training  development  directorate  (DTD)  of  appropriate  schools  and  centers 
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Concept  of  TEA  '79 


Conceptually,  TEA  '79  should  build  on  the  experience  gained  with 
actual  TEA  field  testing  during  TEA  '78.  It  should  provide  for  the 
continued  refinement  of  TEA  methodology  designed  and  proposed  as  a  part  of 
the  TEA  '85  program.  It  should  also  be  consistent  with  the  ISD  model 
established  by  TRADOC  Pam  350-30.  TEA  testing,  however,  should  be 
broadened  in  scope  to  include  progressively  deeper  research  into  the 
impact  of  operational  challenges.  Further,  development  of  testing 
methodology  to  link  job  performance  deficiencies  to  causative  factors  and 
the  preparation  of  a  job  aid  for  training  development  testers  initiated  in 
conjunction  with  XM1  OT  II  must  be  continued.  Test  development  should 
include  the  six-phase  process  conceptualized  in  Annex  B — TEA'85.  Those 
phases  are: 

a.  Front  End  Analysis 

b.  Design  Development  Phase 

c.  TEA  Testing  Phase 

d.  Evaluation  Phase 

e.  Revision 

f.  Rear  End  Analysis 

The  first  iteration  of  testing  in  TEA  '78  was  largely  designed  to 
identify  existing  training  programs,  levels  of  proficiency,  and  training 
needs.  Second  generation  testing  should  be  designed  to  investigate  TEA 
core  objectives  and  situational  variables  by  creating  conditions  of 
turbulence,  various  levels  of  manning,  equipment  fill,  etc.  This  concept 
of  testing  is  necessary  to  ensure  trainability  of  new  systems  and  to 
supply  the  necessary  updated  information  to  the  BTM  data  base  apace  with 
the  introduction  of  new  systems.  Full  development  of  this  TEA  '79  model 
wilL  begin  in  conjunction  with  XM1  OT  II. 

TEA  '79  Tests 


The  following  studies  should  be  initiated  in  FY  '79  to  collect  essen¬ 
tial  data  necessary  tomore  precisely  define  problem  causation  and  to  yield 
data  which  can  be  used  to  develop  the  means  to  correct  those  training 
problems  while  at  the  same  time  providing  data  to  the  ARTS  data  base  for 
factoring  into  BTM  programming. 


a.  Title:  Tank.  Crew  Stability  Research.  School/Agency:  USAARMC/ARI 


Objectives 


Sample 

Size  Data  Collection 


1)  Measure  the  effect 
of  crew  stability 
upon  tank  gunnery 
performance . 


2  Armor  Bns 
(108  crews) 

(1  Bn  USAREUR) 
(1  Bn  CONUS) 


2)  Measure  the  effect 
of  TC/Gnr  stability 
as  opposed  to  full 
crew  stability. 

3)  Determine  training 
resources  to  proficiency 
attributable  to  stabilized 
versus  nonstabilized  units 
as  a  function  of  the 
probability  of  hit  (Ph)  . 


Tank  crew  stability 
questionnaire 


Demographic  ques¬ 
tionnaire  tank 
Table  VIII  scores 


Concept:  Tank  crew  stability  research  is  required  to  establish  the  base¬ 

line  potential  crew  performance  in  CONUS  and  USAREUR  for  M60A1  tank  proba¬ 
bility  of  hit  (Ph)  in  comparison  to  AMSAA  data.  Tank  crew  turbulence 
testing  results  from  TEA  '78  revealed  a  less  then  required  standard  of 
gunnery  proficiency.  Personnel  instability  among  baseline  crews  was  so 
similar  to  crews  in  which  turbulence  was  induced  that  the  effect  of  turbu¬ 
lence  could  not  be  isolated  as  the  sole  causative  factor  because  the 
performance  potential  of  present  gunnery  programs  had  not  been 
established.  This  was  indicated  by  two  test  results:  first,  scrambled 
crews  and  crews  with  non-MOS  qualified  gunners  and  loaders  fired  as 
proficiently  as  baseline  crews;  second,  all  crews  fired  below  system 
capabilities  established  by  the  AMSAA  curve.  In  order  to  determine  the 
extent  of  system  performance  degradation,  it  is  necessary  to  attain  full 
crew  stabilization  through  at  least  two  gunnery  programs  in  CONUS  and 
USAREUR  (approximately  one  year)  and  compare  the  results  of  Table  VIII 
(and  IX  in  USAREUR)  with  two  other  randomly  selected  battalions  which  have 
experienced  normal  turnover  and  turbulence.  Analysis  of  data  from  the 
M60A1  WSTEA,  the  ARTS  "Best  Battalion"  Costing  Survey,  and  the  Tank  Crew 
Turbulence  Test  indicates  that  only  minor  changes  in  the  personnel  assign¬ 
ment  policy  at  battalion  would  be  required  (as  reported  by  the  Tank  Force 
Management  Group  55  percent  of  turbulence  is  generated  at  the  battalion 
level)  .  What  Is  necessary  is  to  limit  battalion  and  company  command 


command  authority  to  shift  tank  crewmen  from  one  position/crew/unit  to 
another  for  one  year.  (Core  objectives  and  situational  variables  are 
listed  at  Appendix  1). 


b.  Title:  CAMMS/CATTS  Follow-on  Test  Sc hool/Agency :  CAC/ARI 


Objectives 


Sample 

Size 


10  Bn 

command  groups 
(502  AC) 

(50%  RC) 

2)  Establish  methodology 
to  relate  unit  train¬ 
ing  proficiency  to  the 
type  and  amount  of  per¬ 
formance  improvement 

by  command  group  use  of 
CAMMS. 

3)  Develop  an  assessment 
tool  external  to  CAMMS. 


1)  Confirm  effective¬ 
ness  of  CAMMS  as  a 
training  method. 


Data  Collection 


Gnd  gp/staff  module 
ARTEP  71-2 

Pre-and  post-test 
evaluation 

Performance  measure¬ 
ment  plan. 

a)  CAMMS 

b)  Extend  to  CATTS 


4)  Determine  effects  of  stability/instability  on  collective  profici¬ 
encies. 

Concept:  CAMMS  testing  for  TEA  '78  research  was  very  beneficial  in  ad¬ 
vancing  the  state  of  the  art  in  measuring  tactical  readiness  and  in 
providing  preliminary  insights  into  the  learning/decay  phenomena 
associated  with  computer  assisted  battle  simulations.  The  research, 
however,  was  limited  by  the  small  sample  (five  battalion  command  groups) 
which  could  be  tested  in  the  available  time.  Further,  research  to  date 
has  established  the  need  for  an  assessment  tool  external  to  CAMMS.  TEA 
' / 9  testing  should  provide  that  units  completing  CAMMS  exercises  also  play 
CATTS  so  that  any  special  skills  unique  to  the  CAMMS  vehicle  (as  opposed 
to  content)  can  be  detected  and  discounted.  Additionally,  data  are 
required  on  the  performance  of  more  command  groups  so  that  subsequent 
evaluations  of  unit  performance  at  the  National  Training  Center  (NTC)  can 
be  correlated  with  command  group  and  staff  performance  on  CAMMS  and  to 
actual  unit  proficiency  on  ARTEP  tasks.  A  longitudinal  study  is  also 
necessary  to  determine  the  effects  of  turnover/ turbulence  on  proficiency 
at  CAMMS  as  opposed  to  field  performance  at  the  NTC.  (Core  objectives  and 
situational  variables  are  listed  at  Appendix  1). 
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c.  Title:  XM1  OT  III  School/Agency :  USAARMC/ARI,  OTEA 

Concept:  TEA  '79  interest  in  XM1  OT  III  derives  fromthe  ongoing  OT  II 
objectives  and  test  activities  scheduled  for  completion  in  December  1979. 
ARTS  TEA  '78  efforts  are  oriented  toward  developmental  testing  improve¬ 
ments  in  prototype  skills  and  job  performance  aids  to  assist  in  establish¬ 
ing  a  more  advanced  body  of  professional  knowledge  for  the  conduct  of 
future  TEA.  TEA  objectives  and  data  collection  plans  for  XM1  OT  III 
remain  as  depicted  on  page  A-13  of  the  TEA  '78  Management  System  package 
(Appendix  1  to  Annex  A).  Additional  methodology  development  objectives 
are  discussed  in  the  paragraph  on  the  future  TEA  later  in  this  paper. 

(Core  objectives  and  situational  variables  are  listed  in  Appendix  1.) 

d.  Title:  Proficiency  and  Learning  Decay  School/Agency :  TBD 


Sample 

Size  Data  Collection 


1) 


Investigate  the  100  basic 

relations  between  armor  trainees 

over-learning,  type 
skills,  (cognitive  100  basic 

sequential,  discrim-  infantry 

inatory,  etc.)  trainees 

type  instruction, 
and  demographic  vari-  100  basic 

ables .  artillery 

trainees 


Demographical  data 

End  of  course  test 
scores 

Subsequent  end  of  test 
scores  over  time. 


2)  Determine  resource  im¬ 
plications  associated 
with  learning  decay  for 
Armor  and  Mech  Infantry 
MOS. 

3)  Investigate  the  operative 
factors  required  to  validate 
the  ARI  model  for  predicting 
skill  retention  by  specific 
tasks . 


Concept:  The  TEA  '78  research  into  this  subject  was  not  of  sufficient 

precision  to  justify  training  decisions  or  action  on  some  very  important 
issues — specifically,  proficiency  loss  by  lower  mental  category  personnel. 
This  situation  could  have  serious  repercussions  on  the  force  in  coming 
years.  The  reasons  for  this  are:  first,  these  mental  categories  comprise 
the  majority  of  new  armor  accessions  (and  by  implication,  infantry  and 
artillery  accessions);  second,  skill  retention  is  least  in  those  very 
areas  upon  which  leader  proficiency  is  dependent;  and  third,  equipment  of 
the  future  is  likely  to  be  more  complex  and  to  require  a  higher  degree  of 
skill  retention.  In  the  TEA  '78  research,  a  large  number  of  variables 
were  examined  and  there  will  likely  be  some  confounding  or  interdepen¬ 
dence  of  such  variables  in  an  operational  environment.  For  example,  unit 
of  assignment  was  somewhat  confounded  with  time  of  retention  testing.  In 
some  units  tested,  the  bulk  of  examinees  were  relatively  new  arrivals  to 
the  unit.  In  other  units  tested  near  the  end  of  the  study,  all  examinees 
had  been  in  the  unit  for  15  weeks  or  more.  Since  there  was  a  significant 
performance  difference  among  units,  this  difference  was  confounded  with 
time  between  graduation  and  the  retention  test,  and  perhaps  affected 
retention  results  over  time.  This  problem  could  have  been  avoided  by 
sending  out  several  test  teams  at  the  same  time  and  by  assuring  that  the 
OS  IT  graduates  in  December  1  977  to  March  1978  time  frame  were  assigned 
uniformly  to  tested  units.  Resource  and  practical  constraints  did  not 
allow  such  an  approach  to  be  taken. 

.An  ideal  study  of  retention  of  combat  skills  will  be  impossible  to 
conduct  in  the  normal  operational  environment.  Learning  in  the  insti¬ 
tution  will  have  to  be  tightly  controlled  and  measured  to  ascertain  that 
all  tasks  were  learned  to  the  same  level  by  all  personnel.  Constant, 
well-trained  teams  of  testors  would  be  necessary  for  testing  in  the 
institution  and  in  the  units.  Unit  training  will  have  to  be  carefully 
documented  to  determine  the  effects  of  different  approaches.  Resource  and 
practical  constraints  have  made  such  an  approach  Impractical  to  date.  By 
planning  ahead,  however,  research  can  start  in  the  right  direction  by 
looking  at  limited,  carefully  analyzed  sets  of  tasks  in  controllable 
situations.  By  limiting  examinees  to  100  for  each  training  center,  test 
requirements  should  be  able  to  be  supported  by  units  in  the  field.  The 
TEA  '78  study  provides  a  general  picture  of  armor  skill  retention;  next, 
perhaps  such  retention  can  be  more  carefully  analyzed  a  small  piece  at  a 
time. 

Several  specific  future  directions  for  retention  research  are 
suggested  In  TEA  '78  results.  Critical  skills  need  to  be  further  dis¬ 
integrated  into  their  components  so  that  specific  elements  which  are  C-8 
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difficult  to  retain  can  be  identified.  This  data  can  validate  a  model 
predicting  skill  retention  for  various  types  of  skills  such  as  mechanical, 
procedural,  and  cognitive.  A  prototype  of  such  a  model  has  been  developed 
by  ARI.  Research  is  needed  to  further  address  whether  cognitively 
organized  skills  are  indeed  harder  to  retain,  and  if  so  why.  Particular 
emphasis  should  be  placed  on  lower  aptitude  personnel.  Questions  to  be 
answered  include:  Is  the  finding  related  to  the  organization  of  skill 
representation  in  memory?  Are  there  ways  in  which  these  skills  can  be 
better  organized  (e.g.,  by  memory  aids)  to  improve  retention?  Study 
should  be  done  on  retention  using  measures  more  analytical  than  the  simple 
"Go”  or  "No  Go"  criteria.  Such  work  may  eventually  lead  to  models 
accurately  predicting  skill  retention  by  specific  types.  Optimal  training 
and  retraining  programs  could  then  be  developed.  In  addition,  since  a 
lower  mental  category  has  to  date  equated  with  more  frequent  or  lengthy 
retraining  to  maintain  proficiency,  it  is  very  important  to  determine  with 
precision  how  much  more  it  costs  in  terms  of  people,  dollars,  and  time  to 
train,  retrain  and,  thus,  to  retain  lower  mental  category  personnel  in  a 
combat  MOS.  Specific  answers  to  these  questions  are  necessary  to 
determine  cost-benefits  attendant  to  allocation  of  resources  to  attract 
and  maintain  personnel  with  higher  mental  qualifications  versus  resources 
for  more  frequent  and  more  costly  training.  Such  data  will  be  needed  in 
the  future  to  replace  survey  derived  data  now  factored  into  the  BTM. 

(Core  objectives  and  situational  variables  are  listed  at  Appendix  1.) 

e.  Title:  Battalion  Training  Model  (BTM)  Training/ Ba ttle  Drill 

Training  Program  Test.  School/Agency:  TBD 

Sample 

Objectives  Size  Data  Collection 

1)  Detemine  the  rela-  4  AR  Bn  Demographic  data 

tionships  between  4  IN  (M)  Bn 

training  as  currently  SM/ARTKP  type  test 

conducted  and  multi-  results 

echelon  Integrated 
training  conducted 

using  the  BTM  training  Gunnery  results 

program  and  tested 
levels  of  proficiency. 


Training  program  and 
and  resource  data 


Object  ives 


Sample 

Size 


Data  Collection 


2 )  Determine  the 

training  resources 
( people ,  dollars, 
t ime)  required  by 
the  training  alterna¬ 
tives  of  conventional 
training  and  the  BTM 
training  program. 


3)  Validate  the  training  and 
battle  drill  formulations 
and  their  associated  training 
packets . 


Concept:  A  mechanized  infantry  battalion  training  program  based  upon 

multiechelon  integrated  training  was  formulated  and  presented  with  the 
initial  BTM  Report.  An  armor  battalion  program  will  be  developed  next. 
These  programs  should  be  tested  at  the  earliest  opportunity.  Following  . 
train-up  program  on  how  to  plan  and  conduct  training  in  accordance  with 
the  ARTS  developed  concepts,  selected  test  battalions  should  conduct 
training  according  to  the  BTM  training  program.  During  this  training, 
units  would  use  the  appropriate  training  and  battle  drill  formulations  a: 
training  support  packets.  The  results  of  the  training  of  the  test 
Battalions  could  then  be  compared  to  the  training  results  of  the  conven¬ 
tional  training  programs  of  the  control  battalions. 


School:  USAOCCS 

Data  Collection 


TBD 

t imun  spectrum  of 
tasks  for  MOS  63C/H. 

2)  Measure  63C/H  supervisor 
capab i 1 ity . 

3)  Determine  a  workable  method 
to  use  the  proficiency  of 
the  training  base  to  raise 
the  proficiency  in  the  field 
of, mechanics  and  supervisors. 


f.  Title:  63C/H  Follow-on  Test 

S  ample 

Objectives  Size 

1)  Determine  the  op-  TBD 


Concept:  TEA  '79  interest  in  MOS  63C/H  derives  from  the  findings  in  TEA 

'78  that  proficiency  in  the  field  was  low  and  that  no  systematic  on-the- 
job  training  (OJT )  programs  for  maintenance  personnel  were  observed  in  the 
units  visited.  TEA  '78  testing  was  designed  to  determine  proficiency 
development  profiles  for  63C,  track  vehicle  mechanics  and  63H,  tank  auto¬ 
motive  repairmen  as  a  function  of  MOS,  aptitude  scores  and  rank.  Soldiers 
tested  were  assigned  to  CONUS  and  USAREUR  based  active  Army  divisions  and 
one  National  Guard  division.  Data  were  collected  using  both  hands-on 
examinations  and  questionnaires.  Data  coded  and  placed  in  a  computerized 
data  base.  Test  results  also  indicated  that  proficiency  developed  during 
AIT  decays  very  rapidly  if  not  reinforced  on  the  job  at  an  appropriate 
interval.  The  lack  of  a  systematic  OJT  program  could  have  serious  ramifi¬ 
cations  should  the  Army  encounter  conditions  of  changing  support  require¬ 
ments  or  supply  disruptions  such  as  would  result  if  the  nation  went  to 
war.  In  that  event,  the  policies  often  resorted  to  by  commanders,  such  as 
over  specialization  of  personnel  and  heavy  reliance  on  replacement  rather 
than  repair,  would  have  to  be  modified  with  an  accompanying  decline  in 
equipment  availability.  TEA  '79  efforts  should  focus  on  resolving  the 
problems  described  in  TEA  '78.  At  least  until  effective  field  sustainment 
training  programs  are  established,  the  concept  of  training  and  develop¬ 
ment  of  maintenance  personnel  on  a  broad  spectrum  MOS  as  opposed  to 
specific  job  or  duty  position  requirements  should  be  examined.  A  test 
should  be  done  to  determine  the  best  way  to  use  the  proficiency  of  the 
training  base  to  raise  the  proficiency  in  the  f ie ld--poss ib 1 e  solutions 
which  might  be  explored  include:  the  use  of  job  aids  and/or  TEC  and  the 
use  of  a  USAOCCS  prepared  training  package.  Consideration  should  be  given 
to  training  both  supervisors  and  subordinates.  If  the  unsatisfactory 
level  of  supervisor  competence  revealed  in  TEA  '78  is  determined  to  be 
wide-spread,  the  USAOCCS  should  consider  establishing  immediate  programs 
to  alleviate  the  situation.  (Core  objectives  and  situational  variables 
listed  at  Appendix  1.) 


Appendix  1  -  Core  Objective  &  Situational  Variables  for  TEA  * 7 *> 


Test  Title 


Core  Objectives  & 
Situational  Variables-^ 


MbOAl 


M60A1  Modular  Training  for  RC  A.  Continue  validation  of 

theat-oriented  SM/AKTEPs, 


B.  Determine  time/costs  to 
achieve  proficiency. 

13.  Determine  allocation  of 

tasks  between  institution/ 
unit . 

19.  Evaluate  rapid  refresher 
training  programs. 

25.  Validate  the  effective¬ 
ness  and  efficiency  of 
training  devices. 


MbOAl 


M60A1  Scaled  Range  Sub-Caliber  C. 
Exercise 


Determine  time/costs  to 
achieve  proficiency. 


Determine  allocation  of 
tasks  between  institution/ 
unit . 

Determine  effects  of  less 
capable  trainees. 

Develop  training  concept 
to  train  with  reduced 
resources . 

Validate  the  effective¬ 
ness  and  efficiency  of 
training  devices. 


ICore  objective  (A-D)  and  situational  variables  (1-26)  are  defined  in 
detail  in  Appendix  1  to  Annex  B. 
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Core  Objectives  & 


SWT 

Test  Title 

Situational  Variables 

TOW 

TOV  TEA 

A. 

Continue  validation  of 
threat-oriented  SM/ARTEPs. 

3. 

Determine  allocation  of 
tasks  between  institution/ 
unit . 

12. 

Determine  exportable 
training  packages  to  sup¬ 
port  training. 

18. 

Determine  effects  of  less 
capable  trainees. 

19. 

Evaluate  rapid  refresher 
training  problems. 

23. 

Validate  the  effective¬ 
ness  and  efficiency  of 
training  devices. 

USAFAS 

FO/Unit  Training 

A. 

Continue  validation  of 
threat-oriented  SM/ARTEPs. 

B. 

Determine  time/costs  to 
achieve  proficiency  as  re¬ 
flected  by  unit  training  ] 

schedules . 

C. 

Develop  diagnostic  tests 
to  measure  proficiency. 

16. 

Determine  effects  of  sta¬ 
bility/instability  on 
proficiency.  ( 

17. 

Determine  effects  of  re¬ 
duced  officer/NCO  fill. 

USAFAS 

OFT  CTEA  Expansion 

B. 

Determine  time/costs  j 

to  achieve  proficiency.  I 

C. 

i 

Develop  diagnostic  test 

to  measure  proficiency 
and  decay  levels. 


C-l-2 


SWT 


Test  Title 


Core  Objectives  fc 
Situational  Variables 


USAJFAS 


CDEC 


19.  Evaluate  rapid  re¬ 
fresher  training  pro 
grams . 


25.  Validate  the  effective¬ 
ness  and  efficiency  of 
training  devices. 


Suitability  of  137  Exported 
Training 


B.  Determine  time/costs 

to  achieve  proficiency. 

C.  Develop  diagnostic  tests 
to  measure  proficiency. 


3.  Determine  allocation  of 
tasks  between  institu¬ 
tion/unit. 


5.  Determine  impact  of 

transfer  of  all  or  por¬ 
tions  of  AIT/BT  to 
FOBS COM. 


Training  Instrumentation 
Evaluation  (TIE  Test) 


12.  Determine  exportable 
training  packages  to 
support  training. 

A.  Continue  validation  of 
threat-oriented  SM/ 
ARTEPs . 

B.  Determine  'time/costs 

to  achieve  proficiency. 
Determine  collective 
learning  decay  by  com¬ 
paring  performance  with 
train-up  phase  (Core 
Objective  C). 


16.  Determine  effects  of 

st ability /instability. 


17.  Determine  effects  of 

reduced  officer/NCO  fill. 


C— 1 —3 


SWT 


Test  Title 


Core  Objectives  & 
Situational  Variables 


USAFAS/ARI 


USAFAS/ARI 


USARRMC/ 

ARI 


Cannon  Crew  Turnover 


25.  Validate  the  effect¬ 
iveness  and  effici¬ 
ency  of  training 
devices . 

C.  Diagnostic  tests  to 
proficiency  and  decay 
levels . 


Retention  &  Proficiency 
of  Common  AIT  Skills 


16.  Determine  effects  of 

stability /instability. 

A.  Continue  validation  of 

threat-oriented  SM/ARTEPs. 

C.  Determine  diagnostic 
tests  to  measure  pro¬ 
ficiency  and  decay  levels. 

3.  Determine  allocation  of 
tasks  between  institu- 
t  ion/unit . 


New  Tests 


Tank  Crew  Stability  Test  A.  Validate  threat-oriented 

critical  SM/ARTEP  tasks, 
conditions,  and  standards. 

B.  Determine  time/costs  to 
proficiencies  for  criti¬ 
cal  ind iv idua 1 /co 1 lec t i ve 
tasks . 


C.  Develop  diagnostic  tests 
to  measure  individual/ 
collective  learning  decay 
leve 1 s . 


SWT 


Test  Tide 


Core  Objectives  & 
Situational  Variables 


D.  Determine  frequency  of 
training  required. 

16.  Determine  effects  of 

stability/instability. 

25.  Validate  effectiveness 
and  efficiency  of 
training  devices. 

CAC/ARI  CAMMS/CATTS  Follow-on  Test  A.  Validate  threat-oriented 

critical  SM/ARTEP  tasks, 
conditions  and  standards, 

B.  Determine  time/costs  to 
proficiencies  for  criti¬ 
cal  ind ividua 1 /co 1 lec- 
tive  tasks. 

C.  Develop  diagnostic  tests 
to  measure  individual/ 
collective  learning  decay 
levels . 

D.  Determine  frequency  of 
retraining  required. 

16.  Determine  effects  of 
stability /instability. 

17.  Determine  effect  of 
reduced  officer/NCO  fill. 

IV.  Evaluate  rapid  refresher 
training. 

20.  Develop  training  concepts 
to  train  with  reduced 
resources . 

25.  Validate  effectiveness 
and  efficiency  of 
training  devices. 


SWT  Test  Title 

USARRMC/  XM1  OT  III 

ARI/OTEA 


Core  Objectives  & 
Situational  Variables 


A.  Validate  threat-oriented 
critical  SM/ARTLP  tasks, 
conditions  and  standards. 

B.  Determine  time/costs  to 
proficiency  for  critical 
individual  collective 
tasks  . 

C.  Develop  diagnostic  tests 
to  measure  individual/ 
collective  learning  decay 
levels . 

D.  Determine  frequency  of 
retraining  required. 

13.  Determine  training  packets 
to  ensure  supervisor 
compe  tence  . 

24.  Develop  training  programs 
to  assimrlate  new  equip¬ 
ment  . 


TBD  Proficiency 


&  Learning  Decay  A. 


Validate  threat-oriented 
critical  SM/ARTEP  tasks, 
conditions  and  standards 


B.  Determine  time/costs  to 
proficiency  for  critical 
indi vidua  1 /co 1 lect i ve 
tasks . 


C.  Develop  diagnostic  tests 
to  measure  individual/ 
collective  learning  decay 
leve 1 s . 


D.  Determine  frequency  of 
retraining  required. 


Test  Title 


Core  Object  ives  A 
Situational  Variables 


BTM  Training/Battle  Drill 
Training  Program  Test 


A.  Validate  threat-oriented 
critical  SM/ARTEP  tasks, 
conditions  and  standards. 

B.  Determine  time/costs  to 
proficiency  for  critical 
individual/collective 
tasks . 

C.  Develop  diagnostic  tests 
to  measure  individual/ 
collective  learning  decay 
leve 1 s . 

D.  Determine  frequency  of 
retraining  required. 

3.  Detemine  allocation  of 
tasks  between  institu- 
t  ion/unit . 

A.  Validate  selected  criti¬ 
cal  tasks  for  service 
school  development  of  how 
to  train  to  combat  profi¬ 
ciency  at  least  cost  in  a 
unit. 

13.  Determine  training  pack¬ 
ages  to  ensure  supervisor 
compe  tence . 

15.  Determine  resources 
required  to  attain  unit 
collective  proficiency. 

16.  Determine  effects  of 
stability/instability. 


17.  Determine  effects  of 
reduced  officer/NCO 


/  s 


SWT  Tea c  Tide 


i 


63C/H  63C/H  FoUo«-on  Test 


Core  Object  i  ves  & 

Situational  Variables 

lb.  Determine  effects  of  less 
capable  personnel  entering 
the  training  base  and  units. 

20.  Develop  training  concepts 
to  train  with  reduced 
resources  . 

25.  Validate  effectiveness 

and  efficiency  of  training 
devices . 

A.  Continue  validation  of 
thi  eat-oriented  SM/'AKTEPs 

B.  Determine  time/costs  to 
achieve  proficiency. 

C.  Determine  decay  rates  and 
frequency  of  lequired 
retraining. 

3.  Determine  allocation  of 

tasks  between  institution/ 
unit. 

12.  Develop  exportable  job 
training  packages  required 
to  support  training. 

13.  Develop  training  packages 
to  ensure  supervisor 
compe  tence . 
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QUALITY 

LEVEL 

TEST  RESULTS 

SURVEY  RESULTS 

batta.  ion  tj-.a:n:::c 

y  n  ;■  ['  OUTPi  .’T 

(QI.l) 

Multiple  vn  1  Id 
tests  and 
cx  _<  .05 

Unbiased  ques¬ 
tionnaire,  con¬ 
trolled  sample, 
vail d  an  a  1 y sis. 

Relative  trend  correct 
absolute  value  of  data 
val  da t ed  by  f  1  e  1  d 
test  ing. 

(QL2) 

Valid  test  and 

o<  <  .20 

Bi  lsed  quest ion- 
r.aire,  controll¬ 
ed  sample,  valid 
analysis  . 

Relative  trend  correct 
absolute  value  of  data 
consistent  with  profes¬ 
sional  judgment  and/or 
survey  data. 

(QL3) 

Data  collect¬ 
ed  and  trends 
ind Icated . 

Unbiased  question¬ 
naire  small  sample, 
no  analysis. 

Relative  trend  correct 
absolute  value  cf  data 
unvalidated . 

(QLA) 

Insights,  not 
directly  sup¬ 
ported  by  data. 

Biased  question¬ 
naire,  snail  sam¬ 
ple,  no  analysis. 

Relative  trend  unvali¬ 
dated  . 

(QL5) 

Information  of  marginal  validity.  Included  primarily  because 
no  better  information  exists.  Use  only  with  deliberate  cau¬ 
tion. 

(QL6) 

Information  judged  to  be  of  insufficient  quality  to  include. 
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